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METHOD AND APPARATUS FOR MONITORING 
TRAFFIC IN A NETWORK 

FIELD OF INVENTION 

The present invention relates to computer networks, specifically to the real-time 
elucidation of packets communicated within a data network, including classification 
according to protocol and application program. 

CROSS-REFERENCE TO RELATED APPLICATION 

This application claims the benefit of U.S. Provisional Patent Application Serial No. 
60/141,903 for METHOD AND APPARATUS FOR MONITORING TRAFFIC IN A 
NETWORK to inventors Dietz, et al., filed June 30, 1999 and assigned to APPTITUDE, 
Inc., the assignee of the present invention. 

COPYRIGHT NOTICE 

A portion of the disclosure of this patent document contains material that is 
subject to copyright protection. The copyright owner has no objection to the facsimile 
reproduction by anyone of the patent document or the patent disclosure, as it appears in 
the Patent and Trademark Office patent file or records, but otherwise reserves all 
copyright rights whatsoever. 

BACKGROUND TO THE PRESENT INVENTION 

There has long been a need for network activity monitors. This need has become 
especially acute, however, given the recent popularity of the Internet and other internets — 
an "internet*' being any plurality of interconnected networks which forms a larger, single 
network. With the growth of networks used as a collection of clients obtaining services 
from one or more servers on the network, it is increasingly important to be able to 
monitor the use of those services and to rate them accordingly. Such objective 
information, for example, as which services (i.e., application programs) are being used, 
who is using them, how often they have been accessed, and for how long, is very useful in 
the maintenance and continued operation of these networks. It is especially important that 
selected users be able to access a network remotely in order to generate reports on 
network use in real time. Similarly, a need exists for a real-time network monitor that can 
provide alarms notifying selected users of problems that may occur with the network or 
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site. 

One prior art monitoring method uses log files. In this method, selected network 
activities may be analyzed retrospectively by reviewing log files, which are maintained by 
network servers and gateways. Log file monitors must access this data and analyze 

5 ("mine") its contents to determine statistics about the server or gateway. Several problems 
exist with this method, however. First, log file information does not provide a map of 
real-time usage; and secondly, log file mining does not supply complete information. This 
method relies on logs maintained by numerous network devices and servers, which 
requires that the information be subjected to refining and correlation. Also, sometimes 

10 information is simply not available to any gateway or server in order to make a log file 
entry. 

One such case, for example, would be information concerning NetMeeting® 
(Microsoft Corporation, Redmond, Washington) sessions in which two computers 
connect directly on the network and the data is never seen by a server or a gateway. 

Another disadvantage of creating log files is that the process requires data logging 
features of network elements to be enabled, placing a substantial load on the device , 
which results in a subsequent decline in network performance. Additionally, log files can 
grow rapidly, there is no standard means of storage for them, and they require a 
significant amount of maintenance. 

Though Netflow® (Cisco Systems, Inc., San Jose, California), RMON2, and other 
network monitors are available for the real-time monitoring of networks, they lack 
visibility into application content and are typically limited to providing network layer 
level information. 

Pattern-matching parser techniques wherein a packet is parsed and pattern filters 
are applied are also known, but these too are limited in how deep into the protocol stack 
they can examine packets. 

Some prior art packet monitors classify packets into connection flows. The term 
"connection flow" is commonly used to describe all the packets involved with a single 
connection. A conversational flow, on the other hand, is the sequence of packets that are 
30 exchanged in any direction as a result of an activity-for instance, the running of an 
application on a server as requested by a client. It is desirable to be able to identify and 
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classify conversational flows rather than only connection flows. The reason for this is that 
some conversational flows involve more than one connection, and some even involve 
more than one exchange of packets between a client and server. This is particularly true 
when using client/server protocols such as RPC, DCOMP, and SAP, which enable a 
5 service to be set up or defined prior to any use of that service. 

An example of such a case is the SAP (Service Advertising Protocol), a NetWare 
(Novell Systems, Provo, Utah) protocol used to identify the services and addresses of 
servers attached to a network. In the initial exchange, a client might send a SAP request to 
a server for print service. The server would then send a SAP reply that identifies a 

10 particular address — for example, SAP#5 — as the print service on that server. Such 
responses might be used to update a table in a router, for instance, known as a Server 
Information Table. A client who has inadvertently seen this reply or who has access to the 
table (via the router that has the Service Information Table) would know that S AP#5 for 
this particular server is a print service. Therefore, in order to print data on the server, such 

15 a client would not need to make a request for a print service, but would simply send data 
to be printed specifying SAP#5. Like the previous exchange, the transmission of data to 
be printed also involves an exchange between a client and a server, but requires a second 
connection and is therefore independent of the initial exchange. In order to eliminate the 
possibility of disjointed conversational exchanges, it is desirable for a network packet 

20 monitor to be able to "virtually concatenate" — that is, to link — the first exchange with the 
second. If the clients were the same, the two packet exchanges would then be correctly 
identified as being part of the same conversational flow. 

Other protocols that may lead to disjointed flows, include RPC (Remote Procedure 
Call); DCOM (Distributed Component Object Model), formerly called Network OLE 

25 (Microsoft Corporation, Redmond, Washington); and CORBA (Common Object Request 
Broker Architecture). RPC is a programming interface from Sun Microsystems (Palo 
Alto, California) that allows one program to use the services of another program in a 
remote machine. DCOM, Microsoft's counterpart to CORBA, defines the remote 
procedure call that allows those objects — objects are self-contained software modules — to 

30 be run remotely over the network. And CORBA, a standard from the Object Management 
Group (OMG) for communicating between distributed objects, provides a way to execute 
programs (objects) written in different programming languages running on different 
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platforms regardless of where they reside in a network. 

What is needed, therefore, is a network monitor that makes it possible to 
continuously analyze all user sessions on a heavily trafficked network. Such a monitor 
should enable non-intrusive, remote detection, characterization, analysis, and capture of 
5 all information passing through any point on the network (U.. of all packets and packet 
streams passing through any location in the network). Not only should all the packets be 
detected and analyzed, but for each of these packets the network monitor should 
determine the protocol (e.g., http, ftp, H.323, VPN, etc.), the application/use within the 
protocol (e.g., voice, video, data, real-time data, etc.), and an end user's pattern of use 
10 within each application or the application context (e.g., options selected, service 

delivered, duration, time of day, data requested, etc.). Also, the network monitor should 
not be reliant upon server resident information such as log fdes. Rather, it should allow a 
user such as a network administrator or an Internet service provider (ISP) the means to 
measure and analyze network activity objectively; to customize the type of data that is 
15 collected and analyzed; to undertake real time analysis; and to receive timely notification 
of network problems. 

Considering the previous SAP example again, because one features of the 
invention is to correctly identify the second exchange as being associated with a print 
service on that server, such exchange would even be recognized if the clients were not the 
20 same. What distinguishes this invention from prior art network monitors is that it has the 
ability to recognize disjointed flows as belonging to the same conversational flow. 

The data value in monitoring network communications has been recognized by 
many inventors. Chiu, et «/., describe a method for collecting information at the session 
level in a computer network in United States Patent 5,101,402, titled "APPARATUS 
25 AND METHOD FOR REAL-TIME MONITORING OF NETWORK SESSIONS AND 
A LOCAL AREA NETWORK" (the "402 patent"). The 402 patent specifies fixed 
locations for particular types of packets to extract information to identify session of a 
packet. For example, if a DECnet packet appears, the 402 patent looks at six specific 
fields (at 6 locations) in the packet in order to identify the session of the packet. If, on the 
30 other hand, an IP packet appears, a different set of six different locations is specified for 
an IP packet. With the proliferation of protocols, clearly the specifying of all the possible 
places to look to determine the session becomes more and more difficult. Likewise, 
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adding a new protocol or application is difficult. In the present invention, the locations 
examined and the information extracted from any packet are adaptively determined from 
information in the packet for the particular type of packet. There is no fixed definition of 
what to look for and where to look in order to form an identifying signature. A monitor 
5 implementation of the present invention, for example, adapts to handle differently IEEE 
802.3 packet from the older Ethernet Type 2 (or Version 2) DIX (Digital-Intel-Xerox) 
packet. 

The 402 patent system is able to recognize up to the session layer. In the present 
invention, the number of levels examined varies for any particular protocol. Furthermore, 
10 the present invention is capable of examining up to whatever level is sufficient to 

uniquely identify to a required level, even all the way to the application level (in the OS I 
model). 

Other prior art systems also are known. Phael describes a network activity monitor 
that processes only randomly selected packets in United States Patent 5,315,580, titled 

15 "NETWORK MONITORING DEVICE AND SYSTEM." Nakamura teaches a network 
monitoring system in United States Patent 4,891,639, titled "MONITORING SYSTEM 
OF NETWORK." Ross, et ai, teach a method and apparatus for analyzing and 
monitoring network activity in United States Patent 5,247,517, titled "METHOD AND 
APPARATUS FOR ANALYSIS NETWORKS," McCreery, et al, describe an Internet 

20 activity monitor that decodes packet data at the Internet protocol level layer in United 
States Patent 5,787,253, titled "APPARATUS AND METHOD OF ANALYZING 
INTERNET ACTIVITY." The McCreery method decodes IP-packets. It goes through the 
decoding operations for each packet, and therefore uses the processing overhead for both 
recognized and unrecognized flows. In a monitor implementation of the present invention, 

25 a signature is built for every flow such that future packets of the flow are easily 
recognized. When a new packet in the flow arrives, the recognition process can 
commence from where it last left off, and a new signature built to recognize new packets 
of the flow. 

A network analyzer should be able to analyze many different protocols. At a base 
30 level, there are a number of standards used in digital telecommunications, including 
Ethernet, HDLC, ISDN, Lap B, ATM, X.25, Frame Relay, Digital Data Service, FDDI 
(Fiber Distributed Data Interface), Tl, and others. Many of these standards employ 
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different packet and/or frame formats. For example, data is transmitted in ATM and 
frame-relay systems in the form of fixed length packets (called "cells") that are 53 octets 
(i.e., bytes) long. Several such cells may be needed to make up the information that might 
be included in the packet employed by some other protocol for the same payload 
5 information— for example in a conversational flow that uses the frame-relay standard or 
the Ethernet protocol. 

In order for a network monitor to be able to analyze different packet or frame 
formats, the monitor needs to be able to perform protocol specific operations on each 
packet with each packet carrying information conforming to different protocols and 
10 related to different applications. For example, the monitor needs to be able to parse 

packets of different formats into fields to understand the data encapsulated in the different 
fields. As the number of possible packet formats or types increases, the amount of logic 
required to parse these different packet formats also increases. 

Prior art network monitors exist that parse individual packets and look for 
15 information at different fields to use for building a signature for identifying packets. Chiu, 
et ai, describe a method for collecting information at the session level in a computer 
network in United States Patent 5,101,402, titled "APPARATUS AND METHOD FOR 
REAL-TIME MONITORING OF NETWORK SESSIONS AND A LOCAL AREA 
NETWORK." In this patent, there are fixed locations specified for particular types of 
20 packets. For example, if a DECnet packet appears, the Chiu system looks at six specific 
fields (at 6 locations) in the packet in order to identify the session of the packet. If, on the 
other hand, an IP packet appears, a different set of six locations is examined. The system 
looks only at the lowest levels up to the protocol layer. There are fixed locations for each 
of the fields that specified the next level. With the proliferation of protocols, clearly the 
25 specifying of all the possible places to look to determine the session becomes more and 
more difficult. Likewise, adding a new protocol or application is difficult. 

It is desirable to be able to adaptively determine the locations and the information 
extracted from any packet for the particular type of packet. In this way, an optimal 
signature may be defined using a protocol-dependent and packet-content-dependent 
30 definition of what to look for and where to look for it in order to form a signature. 

There thus is also a need for a network monitor that can be tailored or adapted for 
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different protocols and for different application programs. There thus is also a need for a 
network monitor that can accommodate new protocols and for new application programs. 
There also is a need for means for specifying new protocols and new levels, including 
new applications. There also is a need for a mechanism to describe protocol specific 
5 operations, including, for example, what information is relevant to packets and packets 
that need to be decoded, and to include specifying parsing operations and extraction 
operations. There also is a need for a mechanism to describe state operations to perform 
on packets that are at a particular state of recognition of a flow in order to further 
recognize the flow. 

10 It is advantageous to collect statistics on packets passing through a point in a 

network rather than to simply count each and every packet. By maintaining statistical 
measures in the flow-entries related to a conversational flow, embodiments of the present 
invention enable specific metrics to be collected in real-time that otherwise would not be 
possible. For example, it is desirable to maintain metrics related to bi-directional 

15 conversations based on the entire flow for each exchange in the conversation. By 

maintaining the state of flow, embodiments of the present invention also enable certain 
metrics related to the states of flows to be determined. 

Most prior-art network traffic monitors that use statistical metrics collect only 
end-point and end-of-session related statistics. Examples of such commonly used metrics 
20 include packet counts, byte counts, session connection time, session timeouts, session and 
transport response times and others. All of these deal with events that can be directly 
related to an event in a single packet. These prior-art systems cannot collect some 
important performance metrics that are related to a complete sequence of packets of a 
flow or to several disjointed sequences of the same flow in a network. 

25 Time based metrics on application data packets are important. Such metrics could 

be determined if all the timestamps and related data could be stored and forwarded for 
later analysis. However when faced with thousands or millions of conversations per 
second on ever faster networks, storing all the data, even if compressed, would take too 
much processing, memory, and manager down load time to be practical. 

30 Thus there is a need for maintaining and reporting time-base metrics from 

statistical measures accumulated from packets in a flow. 
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Network data is properly modeled as a population and not a sample. Thus, all the 
data needs to be processed. Because of the nature of application protocols, just sampling 
some of the packets may not give good measures related to flows. Missing just one 
critical packet, such as one the specified an additional port that data wiU be transmitted 
5 on, or what application will be run, can cause valid data to be lost. 

Thus there is also a need for maintaining and reporting time-base metrics from 
statistical measures accumulated from every packet in a flow. 

There also is a need to determine metrics related to a sequence of events. A good 
example is relative jitter. Measuring the time from the end of one packet in one direction 
10 to another packet with the same signature in the same direction collects data that relates 
normal jitter. This type of jitter metric is good for measuring broad signal quality in a 
packet network. However, it is not specific to the payload or data item being transported 
in a cluster of packets. 

Because of the high speed that packets may be entering the system, embodiments 
15 of the present invention include a cache. It is desirable to maximize the hit rate in a cache 
system. 

Typical prior-art cache systems are used to expediting memory accesses to and 
from microprocessor systems. Various mechanisms are available in such prior art systems 
to predict the lookup such that the hit rate can be maximized. Prior art caches, for 
20 example, can use a lookahead mechanism to predict both instruction cache lookups and 
data cache lookups. Such lookahead mechanisms are not available for a cache subsystem 
for the packet monitoring application. When a new packet enters the monitor, the next 
cache access, for example from the lookup engine, may be for a totally different 
conversational flow than the last cache lookup, and there is no way ahead of time of 
25 knowing what flow the next packet will belong to. 

Thus there is a need in the art for a cache subsystem suitable for use in a packet 
monitor. One desirable property of such a cache system is a least recently used (LRU) 
replacement policy that replaces the LRU flow-entry when a cache replacement is needed. 
Replacing least recently used flow-entries is preferred because it is likely that a packet 
30 following a recent packet will belong to the same flow. Thus, the signature of a new 
packet will likely match a recently used flow record. Conversely, it is not highly likely 
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that a packet associated with the least recently used flow-entry will soon arrive. 

A hash is often used to facilitate lookups. Such a hash may spread entries 
randomly in a database. In such a case, an associative cache is desirable. 

There thus is a need for an associative cache subsystem that also includes a LRU 
5 replacement policy. 

It is desirable for a packet monitor to maintain the state of a flow and to perform 
any state processing necessary to further the process of determining the application 
program associated with a flow. Thus there is a need for a state processor that analyzes 
both new and existing flows in order to classify them by application. 

10 One of the common operations that may be require of a state processor is to search 

the contents of a packet for the existence of one of a set of known strings. Such 
identification may be useful for furthering the process of identifying the application 
content of a conversational flow. For example, it may be desired to search for the uniform 
resource locator (URL) of packets related to the http protocol, or there may be a need to 

15 search for particular strings that identify protocols or aspects of protocols, for example, 
the strings "port", "get", "post," and so forth. Any of these strings may be in a packet, and 
which string and wherein the packet the string resides is often unknown. 

In most common processing systems, the set of instructions implemented are 
general purpose in nature. All processing systems have a typical set of instructions related 
20 to the analysis and manipulation of the Instruction and program counters. These 

instructions include Jump, Call and Return. In addition, these same processing systems 
contain the appropriate instructions to analyze and manipulate registers and memory 
locations. These instructions include Increment, Decrement and Move, Compare and 
Logical manipulation. 

25 While a state processor can includes such a basic set of standard instructions, 

implementing searches for known for one or more known strings in a target data stream 
may take too long using such a set of standard instructions in order to accommodate the 
high speed of packet arrival. It is therefore desirable to have a processor that can perform 
some specific search functions that are required to evaluate the content of and data within 

30 packets on networks extremely rapidly. 
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Specifically, there is a need for a searching apparatus that may be part of the state 
processor and that can rapidly search a target data stream for a specified reference string. 
Furthermore, there is a need for a programmable processor that includes instructions that 
invoke the searching apparatus to perform such a search. 
; Using such a processor in a network monitor enables the monitor to scale and 

meet any network speed requirements. 

SUMMARY 

In its various embodiments the present invention provides a network monitor that 
can accomplish one or more of the following objects and advantages: 

D • Recognize and classify all packets that are exchanges between a client and 

server into respective client/server applications. 

• Recognize and classify at all protocol layer levels conversational flows that 
pass in either direction at a point in a network. 

• Determine the connection and flow progress between clients and servers 
5 according to the individual packets exchanged over a network. 

• Be used to help tune the performance of a network according to the current 
mix of client/server applications requiring network resources. 

• Maintain statistics relevant to the mix of client/server applications using 
network resources. 

20 • Report on the occurrences of specific sequences of packets used by particular 

applications for client/server network conversational flows. 

Other aspects of embodiments of the invention are: 

• Properly analyzing each of the packets exchanged between a client and a 
server and maintaining information relevant to the current state of each of 

25 these conversational flows. 

• Providing a flexible processing system that can be tailored or adapted as new 
applications enter the client/server market. 
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• Maintaining statistics relevant to the conversational flows in a client/sever 
network as classified by an individual application. 

• Reporting a specific identifier, which may be used by other network-oriented 
devices to identify the series of packets with a specific application for a 

5 specific client/server network conversational flow. 

In general, the embodiments of the present invention overcome the problems and 
disadvantages of the art. 

As described herein, one embodiment analyzes each of the packets passing 
through any point in the network in either direction, in order to derive the actual 
10 application used to communicate between a client and a server. Note that there could be 
several simultaneous and overlapping applications executing over the network that are 
independent and asynchronous. 

A monitor embodiment of the invention successfully classifies each of the 
individual packets as they are seen on the network. The contents of the packets are parsed 

15 and selected parts are assembled into a signature (also called a key) that may then be used 
identify further packets of the same conversational flow, for example to further analyze 
the flow and ultimately to recognize the application program. Thus the key is a function 
of the selected parts, and in the preferred embodiment, the function is a concatenation of 
the selected parts. The preferred embodiment forms and remembers the state of any 

20 conversational flow, which is determined by the relationship between individual packets 
and the entire conversational flow over the network. By remembering the state of a flow 
in this way, the embodiment determines the context of the conversational flow, including 
the application program it relates to and parameters such as the time, length of the 
conversational flow, data rate, etc. 

25 The monitor is flexible to adapt to future applications developed for client/server 

networks. New protocols and protocol combinations may be incorporated by compiling 
files written in a high-level protocol description language. 

The monitor embodiment of the present invention is preferably implemented in 
application-specific integrated circuits (ASIC) or field programmable gate arrays (FPGA). 
30 In one embodiment, the monitor comprises a parser subsystem that forms a signature from 
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a packet. The monitor further comprises an analyzer subsystem that receives the signature 
from the parser subsystem. 

A packet acquisition device such as a media access controller (MAC) or a 
segmentation and reassemble module is used to provide packets to the parser subsystem 
5 of the monitor. 

In a hardware implementation, the parsing subsystem comprises two sub-parts, the 
pattern analysis and recognition engine (PRE), and an extraction engine (sheer). The PRE 
interprets each packet, and in particular, interprets individual fields in each packet 
according to a pattern database. 

10 The different protocols that can exist in different layers may be thought of as 

nodes of one or more trees of linked nodes. The packet type is the root of a tree. Each 
protocol is either a parent node or a terminal node. A parent node links a protocol to other 
protocols (child protocols) that can be at higher layer levels. For example, An Ethernet 
packet (the root node) may be an Ethertype packet— also called an Ethernet Type/V ersion 

15 2 and a DDC (DIGITAL-Intel-Xerox packet)— or an IEEE 802.3 packet. Continuing with 
the IEEE 802.3-type packet, one of the children nodes may be the IP protocol, and one of 
the children of the IP protocol may be the TCP protocol. 

The pattern database includes a description of the different headers of packets and 
their contents, and how these relate to the different nodes in a tree. The PRE traverses the 
20 tree as far as it can. If a node does not include a link to a deeper level, pattern matching is 
declared complete. Note that protocols can be the children of several parents. If a unique 
node was generated for each of the possible parent/child trees, the pattern database might 
become excessively large. Instead, child nodes are shared among multiple parents, thus 
compacting the pattern database. 

25 Finally the PRE can be used on its own when only protocol recognition is 

required. 

For each protocol recognized, the sheer extracts important packet elements from 
the packet. These form a signature (i.e., key) for the packet. The sheer also preferably 
generates a hash for rapidly identifying a flow that may have this signature from a 
30 database of known flows. 
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The flow signature of the packet, the hash and at least some of the payload are 
passed to an analyzer subsystem. In a hardware embodiment, the analyzer subsystem 
includes a unified flow key buffer (UFKB) for receiving parts of packets from the parser 
subsystem and for storing signatures in process, a lookup/update engine (LUE) to lookup 

5 a database of flow records for previously encountered conversational flows to determine 
whether a signature is from an existing flow, a state processor (SP) for performing state 
processing, a flow insertion and deletion engine (FIDE) for inserting new flows into the 
database of flows, a memory for storing the database of flows, and a cache for speeding 
up access to the memory containing the flow database. The LUE, SP, and FEDE are all 

10 coupled to the UFKB, and to the cache. 

The unified flow key buffer thus contains the flow signature of the packet, the 
hash and at least some of the payload for analysis in the analyzer subsystem. Many 
operations can be performed to further elucidate the identity of the application program 
content of the packet involved in the client/server conversational flow while a packet 
15 signature exists in the unified flow signature buffer. In the particular hardware 

embodiment of the analyzer subsystem several flows may be processed in parallel, and 
multiple flow signatures from all the packets being analyzed in parallel may be held in the 
one UFKB. 

The first step in the packet analysis process of a packet from the parser subsystem 
20 is to lookup the instance in the current database of known packet flow signatures. A 

lookup/update engine (LUE) accomplishes this task using first the hash, and then the flow 
signature. The search is carried out in the cache and if there is no flow with a matching 
signature in the cache, the lookup engine attempts to retrieve the flow from the flow 
database in the memory. The flow-entry for previously encountered flows preferably 
25 includes state information, which is used in the state processor to execute any operations 
defined for the state, and to determine the next state. A typical state operation may be to 
search for one or more known reference strings in the payload of the packet stored in the 
UFKB. 

Once the lookup processing by the LUE has been completed a flag stating whether 
30 it is found or is new is set within the unified flow signature buffer structure for this packet 
flow signature. For an existing flow, the flow-entry is updated by a calculator component 
of the LUE that adds values to counters in the flow-entry database used to store one or 
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more statistical measures of the flow. The counters are used for determining network 
usage metrics on the flow. 

After the packet flow signature has been looked up and contents of the current 
flow signature are in the database, a state processor can begin analyzing the packet 

5 payload to further elucidate the identity of the application program component of this 
packet. The exact operation of the state processor and functions performed by it will vary 
depending on the current packet sequence in the stream of a conversational flow. The 
state processor moves to the next logical operation stored from the previous packet seen 
with this same flow signature. If any processing is required on this packet, the state 

10 processor will execute instructions from a database of state instruction for this state until 
there are either no more left or the instruction signifies processing. 

In the preferred embodiment, the state processor functions are programmable to 
provide for analyzing new application programs, and new sequences of packets and states 
that can arise from using such application. 

1 5 If during the lookup process for this particular packet flow signature, the flow is 

required to be inserted into the active database, a flow insertion and deletion engine 
(FIDE) is initiated. The state processor also may create new flow signatures and thus may 
instruct the flow insertion and deletion engine to add a new flow to the database as a new 
item. 

20 In the preferred hardware embodiment, each of the LUE, state processor, and 

FIDE operate independently from the other two engines. 

Another aspect of the invention is collecting metrics related to a flow. Using the 
state processing described herein, because the state processor can search for specific data 
payloads, embodiments of the inventive monitor described herein can be programmed to 
25 collect the same jitter metric for a group of packets in a flow that are all related to a 

specific data payload. This allows the inventive system to provide metrics more focused 
on the type of quality related to a set of packets. This in general is more desirable than 
metrics related to single packets when evaluating the performance of a system in a 
network. 

30 Specifically, the monitor system can be programmed to maintain any type of 

metric at any state of a conversational flow. Also the monitor can have the actual statistics 
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programmed into the state at any point. This enables embodiments of the monitor system 
to collect metrics related to network usage and performance, as well as metrics related to 
specific states or sequences of packets. 

Some of the specific metrics that can be collected only with states are events 
5 related to a group of traffic in one direction, events related to the status of a 

communication sequence in one or both directions, events related to the exchange of 
packets for a specific application in a specific sequence. This is only a small sample of the 
metrics that requires an engine that can relate the state of a flow to a set of metrics. 

In addition, because the monitor provides greater visibility to the specific 
10 application in a conversation or flow, the monitor can be programmed to collect metrics 
that may be specific to that type of application or service. In other word, if a flow is for an 
Oracle Database server, an embodiment of monitor could collect the number of packets 
required to complete a transaction. Only with both state and application classification can 
this type of metric be derived from the network. 

15 Because the monitor can be programmed to collect a diverse set of metrics, the 

system can be used as a data source for metrics required in a number of environments. In 
particular, the metrics may be used to monitor and analyze the quality and performance of 
traffic flows related to a specific set of applications. Other implementation could include 
metrics related to billing and charge-back for specific traffic flow and events with the 

20 traffic flows. Yet other implementations could be programmed to provide metrics useful 
for troubleshooting and capacity planning and related directly to a focused application and 
service. 

Another aspect of the invention is determining quality of service metrics based on 
each and every packet. 

25 Thus, disclosed herein is a method of and monitor apparatus for analyzing a flow 

of packets passing through a connection point on a computer network are disclosed that 
may include such quality of service metrics. The method includes receiving a packet from 
a packet acquisition device, and looking up a flow-entry database containing flow-entries 
for previously encountered conversational flows. The looking up to determine if the 

30 received packet is of an existing flow. Each and every packet is processed. If the packet is 
of an existing flow, the method updates the flow-entry of the existing flow, including 
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storing one or more statistical measures kept in the flow-entry. If the packet is of a new 
flow, the method stores a new flow-entry for the new flow in the flow-entry database, 
including storing one or more statistical measures kept in the flow-entry. The statistical 
measures are used to determine metrics related to the flow. The metrics may be base 
5 metrics from which quality of service metrics are determined, or may be the quality of 
service metrics. 

Also described herein is an associative cache system for looking up one or more 
elements of an external memory. The cache system comprises a set of cache memory 
elements coupled to the external memory, a set of content addressable memory cells 

10 (CAMs) containing an address and a pointer to one of the cache memory elements, and 
including a matching circuit having an input such that the CAM asserts a match output 
when the input is the same as the address in the GAM cell. Which cache memory element 
a particular CAM points to changes over time. In the preferred implementation, the 
CAMs are connected in an order from top to bottom, and the bottom CAM points to the 

15 least recently used cache memory element. 

Also disclosed herein is a processor for processing contents of packets passing 
through a connection point on a computer network. The processor includes a searching 
apparatus having one or more comparators for searching for a reference string in the 
contents of a packet. The processor processes contents of all packets passing through the 
20 connection point in real time. In one implementation, the processor is programmable and 
has an instruction set that includes an instruction for invoking the searching apparatus to 
search for a specified reference string in the packet starting at an unknown location within 
a range of the packet. 

Embodiments of searching apparatus that can be used in the processor also are 
25 disclosed. The searching apparatus is configured to search for a reference string of N R 
units in target data starting from any of a set of starting positions within the target data. 
The searching apparatus includes a reference register configured to receive the N R units 
of a reference string, one or more target data registers coupled in series to receive the 
target data; and, a plurality of comparator sets, one comparator set corresponding to each 
30 of the starting positions. The comparator set of a particular starting position is coupled to 
each unit of the reference register and to N R units of the target data registers starting from 
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the particular starting position and comparing the reference register contents to 
corresponding contents of N R contiguous units of the target data registers starting from 
the particular starting position. Each comparator set indicates if there is a match of the 
first reference string in the target data starting from its corresponding different starting 
5 position. The first plurality of comparator sets indicates in parallel if the first reference 
string is contained in the target data registers starting at any of the starting positions. 

BRIEF DESCRIPTION OF THE DRAWINGS 

Although the present invention is better understood by referring to the detailed 
preferred embodiments, these should not be taken to limit the present invention to any 
10 specific embodiment because such embodiments are provided only for the purposes of 
explanation. The embodiments, in turn, are explained with the aid of the following 
figures. 

FIG. 1 is a functional block diagram of a network embodiment of the present 
invention in which a monitor is connected to analyze packets passing at a connection 
15 point. 

FIG. 2 is a diagram representing an example of some of the packets and their 
formats that might be exchanged in starting, as an illustrative example, a conversational 
flow between a client and server on a network being monitored and analyzed. A pair of 
flow signatures particular to this example and to embodiments of the present invention is 
20 also illustrated. This represents some of the possible flow signatures that can be generated 
and used in the process of analyzing packets and of recognizing the particular server 
applications that produce the discrete application packet exchanges. 

FIG. 3 is a functional block diagram of a process embodiment of the present 
invention that can operate as the packet monitor shown in FIG. 1. This process may be 
25 implemented in software or hardware. 

FIG. 4 is a flowchart of a high-level protocol language compiling and optimization 
process, which in one embodiment may be used to generate data for monitoring packets 
according to versions of the present invention. 

FIG. 5 is a flowchart of a packet parsing process used as part of the parser in an 
30 embodiment of the inventive packet monitor. 
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FIG. 6 is a flowchart of a packet element extraction process that is used as part of 
the parser in an embodiment of the inventive packet monitor. 

FIG. 7 is a flowchart of a flow-signature building process that is used as part of 
the parser in the inventive packet monitor. 

5 FIG. 8 is a flowchart of a monitor lookup and update process that is used as part of 

the analyzer in an embodiment of the inventive packet monitor. 

FIG. 9 is a flowchart of an exemplary Sun Microsystems Remote Procedure Call 
application than may be recognized by the inventive packet monitor. 

FIG. 10 is a functional block diagram of a hardware parser subsystem including 
10 the pattern recognizer and extractor that can form part of the parser module in an 
embodiment of the inventive packet monitor. 

FIG. 1 1 is a functional block diagram of a hardware analyzer including a state 
processor that can form part of an embodiment of the inventive packet monitor. 

FIG. 12 is a functional block diagram of a flow insertion and deletion engine 
15 process that can form part of the analyzer in an embodiment of the inventive packet 
monitor. 

FIG. 13 is a flowchart of a state processing process that can form part of the 
analyzer in an embodiment of the inventive packet monitor. 

FIG. 14 is a simple functional block diagram of a process embodiment of the 
20 present invention that can operate as the packet monitor shown in FIG. 1. This process 
may be implemented in software. 

FIG. 15 is a functional block diagram of how the packet monitor of FIG. 3 (and 
FIGS. 10 and 1 1) may operate on a network with a processor such as a microprocessor. 

FIG. 16 is an example of the top (MAC) layer of an Ethernet packet and some of 
25 the elements that may be extracted to form a signature according to one aspect of the 
invention. 

FIG. 17 A is an example of the header of an Ethertype type of Ethernet packet of 
FIG. 16 and some of the elements that may be extracted to form a signature according to 
one aspect of the invention. 
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FIG. 17B is an example of ah IP packet, for example, of the Ethertype packet 
shown in FIGs. 16 and 17A, and some of the elements that may be extracted to form a 
signature according to one aspect of the invention. 

FIG. 18 A is a three-dimensional structure that can be used to store elements of the 
5 pattern, parse and extraction database used by the parser subsystem in accordance to one 
embodiment of the invention. 

FIG. 18B is an alternate form of storing elements of the pattern, parse and 
extraction database used by the parser subsystem in accordance to another embodiment of 
the invention. 

10 FIG. 19 is a block diagram of the state processor component of the analyzer 

subsystem of FIG. 11. 

FIG. 20 is a block diagram of the search engine component of the analyzer 
subsystem of FIG. 1 1 . 

FIG. 21 is a dataflow block diagram showing four individual search modules of 
15 the search engine. 

FIG. 22A is a block diagram of the search engine core; FIG 22B shows a 
comparator component of the core that compares a plurality of inputs to another plurality 
of inputs. 

FIG. 23A shows an implementation of the input core in more detail; FIG 23B 
20 shows a comparator component of the core. 

FIG. 26 is a block diagram of the cache memory part of the cache subsystem 1115 
of the analyzer subsystem of FIG. 1 1 . 

FIG. 27 is a block diagram of the cache memory controller and the cache CAM 
controller of the cache subsystem. 

25 FIG. 28 is a block diagram of one implementation of the CAM array of the cache 

subsystem 1115. 

FIG. 24 shows various PDL file modules to be compiled together by the compiling 
process illustrated in FIG. 20 as an example, in accordance with a compiling aspect of the 
invention. 
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FIG. 25 is a flowchart of the process of compiling high-level language files 
according to an aspect of the invention. 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 

Note that this document includes hardware diagrams and descriptions that may 
5 include signal names. In most cases, the names are sufficiently descriptive, in other cases 
however the signal names are not needed to understand the operation and practice of the 
invention. 

Operation in a Network 

FIG. 1 represents a system embodiment of the present invention that is referred to 
10 herein by the general reference numeral 100. The system 100 has a computer netwo± 102 
that communicates packets (e.g., TP datagrams) between various computers, for example 
between the clients 104-107 and servers 1 10 and 1 12. The network is shown 
schematically as a cloud with several network nodes and links shown in the interior of the 
cloud. A monitor 108 examines the packets passing in either direction past its connection 
15 point 121 and, according to one aspect of the invention, can elucidate what application 
programs are associated with each packet. The monitor 108 is shown examining packets 
(i.e., datagrams) between the network interface 1 16 of the server 1 10 and the network. 
The monitor can also be placed at other points in the network, such as connection point 
123 between the network 102 and the interface 1 18 of the client 104, or some other 
20 location, as indicated schematically by connection point 125 somewhere in network 102. 
Not shown is a network packet acquisition device at the location 123 on the network for 
converting the physical information on the network into packets for input into monitor 
108. Such packet acquisition devices are common. 

Various protocols may be employed by the network to establish and maintain the 
25 required communication, e.g., TCP/IP, etc. Any network activity— for example an 
application program run by the client 104 (CLIENT 1 ) communicating with another 
running on the server 1 10 (SERVER 2)— will produce an exchange of a sequence of 
packets over network 102 that is characteristic of the respective programs and of the 
network protocols. Such characteristics may not be completely revealing at the individual 
30 packet level. It may require the analyzing of many packets by the monitor 108 to have 
enough information needed to recognize particular application programs. The packets 
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may need to be parsed then analyzed in the context of various protocols, for example, the 
transport through the application session layer protocols for packets of a type conforming 
to the ISO layered network model. 

Communication protocols are layered, which is also referred to as a protocol stack. 
5 The ISO (International Standardization Organization) has defined a general model that 
provides a framework for design of communication protocol layers. This model, shown in 
table form below, serves as a basic reference for understanding the functionality of 
existing communication protocols. 



ISO MODEL 



Layer 


Functionality 


Example 


7 


Application 


Telnet, NFS, Novell NCP, HTTP, 
H.323 


6 


Presentation 


XDR 


5 


Session 


RPC, NbTBIOS, SNMP, etc. 


4 


Transport 


TCP, Novel SPX, UDP, etc. 


3 


Network 


IP, Novell IPX, VIP, AppleTalk, etc. 


2 


Data Link 


Network Interface Card (Hardware 
Interface). MAC layer 


1 


Physical 


Ethernet, Token Ring, Frame Relay, 
ATM, Tl (Hardware Connection) 



10 Different communication protocols employ different levels of the ISO model or 

may use a layered model that is similar to but which does not exactly conform to the ISO 
model. A protocol in a certain layer may not be visible to protocols employed at other 
layers. For example, an application (Level 7) may not be able to identify the source 
computer for a communication attempt (Levels 2-3). 

15 In some communication arts, the term "frame" generally refers to encapsulated 

data at OSI layer 2, including a destination address, control bits for flow control, the data 
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or payload, and CRC (cyclic redundancy check) data for error checking. The term 
"packet" generally refers to encapsulated data at OSI layer 3. In the TCP/IP world, the 
term "datagram" is also used. In this specification, the term "packet" is intended to 
encompass packets, datagrams, frames, and cells. In general, a packet format or frame 
5 format refers to how data is encapsulated with various fields and headers for transmission 
across a network. For example, a data packet typically includes an address destination 
field, a length field, an error correcting code (ECC) field, or cyclic redundancy check 
(CRC) field, as well as headers and footers to identify the beginning and end of the 
packet. The terms "packet format" and "frame format," also referred to as "cell format," 
10 are generally synonymous. 

Monitor 108 looks at every packet passing the connection point 121 for analysis. 
However, not every packet carries the same information useful for recognizing all levels 
of the protocol. For example, in a conversational flow associated with a particular 
application, the application will cause the server to send a type-A packet, but so will 
15 another. If, though, the particular application program always follows a type-A packet 
with the sending of a type-B packet, and the other application program does not, then in 
order to recognize packets of that application's conversational flow, the monitor can be 
available to recognize packets that match the type-B packet to associate with the type-A 
packet. If such is recognized after a type-A packet, then the particular application 
20 program' s conversational flow has started to reveal itself to the monitor 108. 

Further packets may need to be examined before the conversational flow can be 
identified as being associated with the application program. Typically, monitor 108 is 
simultaneously also in partial completion of identifying other packet exchanges that are 
parts of conversational flows associated with other applications. One aspect of monitor 
25 108 is its ability to maintain the state of a flow. The state of a flow is an indication of all 
previous events in the flow that lead to recognition of the content of all the protocol 
levels, e.g., the ISO model protocol levels. Another aspect of the invention is forming a 
signature of extracted characteristic portions of the packet that can be used to rapidly 
identify packets belonging to the same flow. 
30 In real-world uses of the monitor 108, the number of packets on the network 102 

passing by the monitor 108' s connection point can exceed a million per second. 
Consequently, the monitor has very little time available to analyze and type each packet 
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and identify and maintain the state of the flows passing through the connection point. The 
monitor 108 therefore masks out all the unimportant parts of each packet that will not 
contribute to its classification. However, the parts to mask-out will change with each 
packet depending on which flow it belongs to and depending on the state of the flow. 

5 The recognition of the packet type, and ultimately of the associated application 

programs according to the packets that their executions produce, is a multi-step process 
within the monitor 108. At a first level, for example, several application programs will all 
produce a first kind of packet. A first "signature" is produced from selected parts of a 
packet that will allow monitor 108 to identify efficiently any packets that belong to the 

10 same flow. In some cases, that packet type may be sufficiently unique to enable the 

monitor to identify the application that generated such a packet in the conversational flow. 
The signature can then be used to efficiently identify all future packets generated in traffic 
related to that application. 

In other cases, that first packet only starts the process of analyzing the 
15 conversational flow, and more packets are necessary to identify the associated application 
program. In such a case, a subsequent packet of a second type — but that potentially 
belongs to the same conversational flow— is recognized by using the signature. At such a 
second level, then, only a few of those application programs will have conversational 
flows that can produce such a second packet type. At this level in the process of 
20 classification, all application programs that are not in the set of those that lead to such a 
sequence of packet types may be excluded in the process of classifying the conversational 
flow that includes these two packets. Based on the known patterns for the protocol and for 
the possible applications, a signature is produced that allows recognition of any future 
packets that may follow in the conversational flow. 

25 It may be that the application is now recognized, or recognition may need to 

proceed to a third level of analysis using the second level signature. For each packet, 
therefore, the monitor parses the packet and generates a signature to determine if this 
signature identified a previously encountered flow, or shall be used to recognize future 
packets belonging to the same conversational flow. In real time, the packet is further 

30 analyzed in the context of the sequence of previously encountered packets (the state), and 
of the possible future sequences such a past sequence may generate in conversational 
flows associated with different applications. A new signature for recognizing future 
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packets may also be generated. This process of analysis continues until the applications 
are identified. The last generated signature may then be used to efficiently recognize 
future packets associated with the same conversational flow. Such an arrangement makes 
it possible for the monitor 108 to cope with millions of packets per second that must be 
5 inspected. 

Another aspect of the invention is adding Eavesdropping. In alternative 
embodiments of the present invention capable of eavesdropping, once the monitor 108 
has recognized the executing application programs passing through some point in the 
network 102 (for example, because of execution of the applications by the client 105 or 
10 server 1 10), the monitor sends a message to some general purpose processor on the 

network that can input the same packets from the same location on the network, and the 
processor then loads its own executable copy of the application program and uses it to 
read the content being exchanged over the network. In other words, once the monitor 108 
has accomplished recognition of the application program, eavesdropping can commence. 

is The Network Monitor 

FIG. 3 shows a network packet monitor 300, in an embodiment of the present 
invention that can be implemented with computer hardware and/or software. The system 
300 is similar to monitor 108 in FIG. 1 . A packet 302 is examined, e.g., from a packet 
acquisition device at the location 121 in network 102 (FIG. 1 j; and the packet evaluated, 
20 for example in an attempt to determine its characteristics, e.g., all the protocol information 
in a multilevel model, including what server application produced the packet. 

The packet acquisition device is a common interface that converts the physical 
signals and then decodes them into bits, and into packets, in accordance with the 
particular network (Ethernet, frame relay, ATM, etc.). The acquisition device indicates to 
25 the monitor 108 the type of network of the acquired packet or packets. 

Aspects shown here include: (1) the initialization of the monitor to generate what 
operations need to occur on packets of different types— accomplished by compiler and 
optimizer 310, (2) the processing— parsing and extraction of selected portions— of 
packets to generate an identifying signature— accomplished by parser subsystem 301, and 
30 (3) the analysis of the packets— accomplished by analyzer 303. 

The purpose of compiler and optimizer 310 is to provide protocol specific 
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information to parser subsystem 301 and to analyzer subsystem 303. The initialization 
occurs prior to operation of the monitor, and only needs to re-occur when new protocols 
are to be added. 

A flow is a stream of packets being exchanged between any two addresses in the 
5 network. For each protocol there are known to be several fields, such as the destination 
(recipient), the source (the sender), and so forth, and these and other fields are used in 
monitor 300 to identify the flow. There are other fields not important for identifying the 
flow, such as checksums, and those parts are not used for identification. 

Parser subsystem 301 examines the packets using pattern recognition process 304 
10 that parses the packet and determines the protocol types and associated headers for each 
protocol layer that exists in the packet 302. An extraction process 306 in parser subsystem 
301 extracts characteristic portions (signature information) from the packet 302. Both the 
pattern information for parsing and the related extraction operations, e.g., extraction 
masks, are supplied from a parsing-pattern-structures and extraction-operations database 
15 (parsing/extractions database) 308 filled by the compiler and optimizer 310. 

The protocol description language (PDL) files 336 describes both patterns and 
states of all protocols that an occur at any layer, including how to interpret header 
information, how to determine from the packet header information the protocols at the 
next layer, and what information to extract for the purpose of identifying a flow, and 
20 ultimately, applications and services. The layer selections database 338 describes the 
particular layering handled by the monitor. That is, what protocols run on top of what 
protocols at any layer level. Thus 336 and 338 combined describe how one would decode, 
analyze, and understand the information in packets, and, furthermore, how the 
information is layered. This information is input into compiler and optimizer 310. 

25 When compiler and optimizer 3 1 0 executes, it generates two sets of internal data 

structures. The first is the set of parsing/extraction operations 308. The pattern structures 
include parsing information and describe what will be recognized in the headers of 
packets; the extraction operations are what elements of a packet are to be extracted from 
the packets based on the patterns that get matched, Thus, database 308 of 

30 parsing/extraction operations includes information describing how to determine a set of 
one or more protocol dependent extraction operations from data in the packet that indicate 
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a protocol used in the packet. 

The other internal data structure that is built by compiler 310 is the set of state 
patterns and processes 326. These are the different states and state transitions that occur in 
different conversational flows, and the state operations that need to be performed (e.g., 
5 patterns that need to be examined and new signatures that need to be built) during any 
state of a conversational flow to further the task of analyzing the conversational flow. 

Thus, compiling the PDL files and layer selections provides monitor 300 with the 
information it needs to begin processing packets. In an alternate embodiment, the contents 
of one or more of databases 308 and 326 may be manually or otherwise generated. Note 
10 that in some embodiments the layering selections information is inherent rather than 
explicitly described. For example, since a PDL file for a protocol includes the child 
protocols, the parent protocols also may be determined. 

In the preferred embodiment, the packet 302 from the acquisition device is input 
into a packet buffer. The pattern recognition process 304 is carried out by a pattern 
15 analysis and recognition (PAR) engine that analyzes and recognizes patterns in the 
packets. In particular, the PAR locates the next protocol field in the header and 
determines the length of the header, and may perform certain other tasks for certain types 
of protocol headers. An example of this is type and length comparison to distinguish an 
TF.FR 802.3 (Ethernet) packet from the older type 2 (or Version 2) Ethernet packet, also 
20 called a DIGITAL-Intel-Xerox (DIX) packet. The PAR also uses the pattern structures 
and extraction operations database 308 to identify the next protocol and parameters 
associated with that protocol that enables analysis of the next protocol layer. Once a 
pattern or a set of patterns has been identified, it/they will be associated with a set of none 
or more extraction operations. These extraction operations (in the form of commands and 
25 associated parameters) are passed to the extraction process 306 implemented by an 
extracting and information identifying (EH) engine that extracts selected parts of the 
packet, including identifying information from the packet as required for recognizing this 
packet as part of a flow. The extracted information is put in sequence and then processed 
in block 312 to build a unique flow signature (also called a "key") for this flow. A flow 
30 signature depends on the protocols used in the packet. For some protocols, the extracted 
components may include source and destination addresses. For example, Ethernet frames 
have end-point addresses that are useful in building a better flow signature. Thus, the 
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signature typically includes the client and server address pairs. The signature is used to 
recognize further packets that are or may be part of this flow. 

In the preferred embodiment, the building of the flow key includes generating a 
hash of the signature using a hash function. The purpose if using such a hash is 
5 conventional— to spread flow-entries identified by the signature across a database for 
efficient searching. The hash generated is preferably based on a hashing algorithm and 
such hash generation is known to those in the art. 

In one embodiment, the parser passes data from the packet — a parser record — that 
includes the signature (i.e., selected portions of the packet), the hash, and the packet itself 

10 to allow for any state processing that requires further data from the packet. An improved 
embodiment of the parser subsystem might generate a parser record that has some 
predefined structure and that includes the signature, the hash, some flags related to some 
of the fields in the parser record, and parts of the packet's payload that the parser 
subsystem has determined might be required for further processing, e.g., for state 

15 processing. 

Note that alternate embodiments may use some function other than concatenation 
of the selected portions of the packet to make the identifying signature. For example, 
some "digest function" of the concatenated selected portions may be used. 

The parser record is passed onto lookup process 314 which looks in an internal 
20 data store of records of known flows that the system has already encountered, and decides 
(in 316) whether or not this particular packet belongs to a known flow as indicated by the 
presence of a flow-entry matching this flow in a database of known flows 324. A record 
in database 324 is associated with each encountered flow. 

The parser record enters a buffer called the unified flow key buffer (UFKB). The 
25 UFKB stores the data on flows in a data structure that is similar to the parser record, but 
that includes a field that can be modified. In particular, one or the UFKB record fields 
stores the packet sequence number, and another is filled with state information in the form 
of a program counter for a state processor that implements state processing 328. 

The determination (3 1 6) of whether a record with the same signature already 
30 exists is earned out by a lookup engine (LUE) that obtains new UFKB records and uses 
the hash in the UFKB record to lookup if there is a matching known flow. In the 
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particular embodiment, the database of known flows 324 is in an external memory. A 
cache is associated with the database 324. A lookup by the LUE for a known record is 
carried out by accessing the cache using the hash, and if the entry is not already present in 
the cache, the entry is looked up (again using the hash) in the external memory. 

5 The flow-entry database 324 stores flow-entries that include the unique flow- 

signature, state information, and extracted information from the packet for updating 
flows, and one or more statistical about the flow. Each entry completely describes a flow. 
Database 324 is organized into bins that contain a number, denoted N, of flow-entries 
(also called flow-entries, each a bucket), with N being 4 in the preferred embodiment. 

10 Buckets (i.e., flow-entries) are accessed via the hash of the packet from the parser 

subsystem 301 (i.e., the hash in the UFKB record). The hash spreads the flows across the 
database to allow for fast lookups of entries, allowing shallower buckets. The designer 
selects the bucket depth N based on the amount of memory attached to the monitor, and 
the number of bits of the hash data value used. For example, in one embodiment, each 

15 flow-entry is 128 bytes long, so for 128K flow-entries, 16 Mbytes are required. Using a 
16-bit hash gives two flow-entries per bucket. Empirically, this has been shown to be 
more than adequate for the vast majority of cases. Note that another embodiment uses 
flow-entries that are 256 bytes long. 

Herein, whenever an access to database 324 is described, it is to be understood 
20 that the access is via the cache, unless otherwise stated or clear from the context. 

If there is no flow-entry found matching the signature, i.e., the signature is for a 
new flow, then a protocol and state identification process 318 further determines the state 
and protocol. That is, process 318 determines the protocols and where in the state 
sequence for a flow for this protocol's this packet belongs. Identification process 318 uses 
25 the extracted information and makes reference to the database 326 of state patterns and 
processes. Process 318 is then followed by any state operations that need to be executed 
on this packet by a state processor 328. 

If the packet is found to have a matching flow-entry in the database 324 (e.g., in 
the cache), then a process 320 determines, from the looked-up flow-entry, if more 
30 classification by state processing of the flow signature is necessary. If not, a process 322 
updates the flow-entry in the flow-entry database 324 (e.g., via the cache). Updating 
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includes updating one or more statistical measures stored in the flow-entry. In our 
embodiment, the statistical measures are stored in counters in the flow-entry. 

If state processing is required, state process 328 is commenced. State processor 
328 carries out any state operations specified for the state of the flow and updates the state 
5 to the next state according to a set of state instructions obtained form the state pattern and 
processes database 326. 

The state processor 328 analyzes both new and existing flows in order to analyze 
all levels of the protocol stack, ultimately classifying the flows by application (level 7 in 
the ISO model). It does this by proceeding from state-to-state based on predefined state 

10 transition rules and state operations as specified in state processor instruction database 
326. A state transition rule is a rule typically containing a test followed by the next-state 
to proceed to if the test result is true. An operation is an operation to be performed while 
the state processor is in a particular state — for example, in order to evaluate a quantity 
needed to apply the state transition rule. The state processor goes through each rule and 

15 each state process until the test is true, or there are no more tests to perform. 

In general, the set of state operations may be none or more operations on a packet, 
and carrying out the operation or operations may leave one in a state that causes exiting 
the system prior to completing the identification, but possibly knowing more about what 
state and state processes are needed to execute next, i.e., when a next packet of this flow 
20 is encountered. As an example, a state process (set of state operations) at a particular state 
may build a new signature for future recognition packets of the next state. 

By maintaining the state of the flows and knowing that new flows may be set up 
using the information from previously encountered flows, the network traffic monitor 300 
provides for (a) single-packet protocol recognition of flows, and (b) multiple-packet 
25 protocol recognition of flows. Monitor 300 can even recognize the application program 
from one or more disjointed sub-flows that occur in server announcement type flows. 
What may seem to prior art monitors to be some unassociated flow, may be recognized by 
the inventive monitor using the flow signature to be a sub-flow associated with a 
previously encountered sub-flow. 

30 Thus, state processor 328 applies the first state operation to the packet for this 

particular flow-entry. A process 330 decides if more operations need to be performed for 
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this state. If so, the analyzer continues looping between block 330 and 328 applying 
additional state operations to this particular packet until all those operations are 
completed — that is, there are no more operations for this packet in this state. A process 
332 decides if there are further states to be analyzed for this type of flow according to the 
5 state of the flow and the protocol, in order to fully characterize the flow. If not, the 
conversational flow has now been fully characterized and a process 334 finalizes the 
classification of the conversational flow for the flow. 

In the particular embodiment, the state processor 328 starts the state processing by 
using the last protocol recognized by the parser as an offset into a jump table (jump 

10 vector). The jump table finds the state processor instructions to use for that protocol in the 
state patterns and processes database 326. Most instructions test something in the unified 
flow key buffer, or the flow-entry in the database of known flows 324, if the entry exists. 
The state processor may have to test bits, do comparisons, add, or subtract to perform the 
test. For example, a common operation carried out by the state processor is searching for 

15 one or more patterns in the payload part of the UFKB. 

Thus, in 332 in the classification, the analyzer decides whether the flow is at an 
end state. If not at an end state, the flow-entry is updated (or created if a new flow) for 
this flow-entry in process 322. 

Furthermore, if the flow is known and if in 332 it is determined that there are 
20 further states to be processed using later packets, the flow-entry is updated in process 322. 

The flow-entry also is updated after classification finalization so that any further 
packets belonging to this flow will be readily identified from their signature as belonging 
to this fully analyzed conversational flow. 

After updating, database 324 therefore includes the set of all the conversational 
25 flows that have occurred. 

Thus, the embodiment of present invention shown in FIG. 3 automatically 
maintains flow-entries, which in one aspect includes storing states. The monitor of FIG. 3 
also generates characteristic parts of packets — the signatures — that can be used to 
recognize flows. The flow-entries may be identified and accessed by their signatures. 
30 Once a packet is identified to be from a known flow, the state of the flow is known and 
this knowledge enables state transition analysis to be performed in real time for each 
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different protocol and application. In a complex analysis, state transitions are traversed as 
more and more packets are examined. Future packets that are part of the same 
conversational flow have their state analysis continued from a previously achieved state. 
When enough packets related to an application of interest have been processed, a final 
5 recognition state is ultimately reached, i.e., a set of states has been traversed by state 
analysis to completely characterize the conversational flow. The signature for that final 
state enables each new incoming packet of the same conversational flow to be 
individually recognized in real time. 

In this manner, one of the great advantages of the present invention is realized. 
10 Once a particular set of state transitions has been traversed for the first time and ends in a 
final state, a short-cut recognition pattern — a signature — can be generated that will key on 
every new incoming packet that relates to the conversational flow. Checking a signature 
involves a simple operation, allowing high packet rates to be successfully monitored on 
the network. 

15 In improved embodiments, several state analyzers are run in parallel so that a large 

number of protocols and applications may be checked for. Every known protocol and 
application will have at least one unique set of state transitions, and can therefore be 
uniquely identified by watching such transitions. 

When each new conversational flow starts, signatures that recognize the flow are 
20 automatically generated on-the-fly, and as further packets in the conversational flow are 
encountered, signatures are updated and the states of the set of state transitions for any 
potential application are further traversed according to the state transition rules for the 
flow. The new states for the flow — those associated with a set of state transitions for one 
or more potential applications — are added to the records of previously encountered states 
25 for easy recognition and retrieval when a new packet in the flow is encountered. 

Detailed operation 

FIG. 4 diagrams an initialization system 400 that includes the compilation process. 
That is, part of the initialization generates the pattern structures and extraction operations 
database 308 and the state instruction database 328. Such initialization can occur off-line 
30 or from a central location. 
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The different protocols that can exist in different layers may be thought of as 
nodes of one or more trees of linked nodes. The packet type is the root of a tree (called 
level 0). Each protocol is either a parent node or a terminal node. A parent node links a 
protocol to other protocols (child protocols) that can be at higher layer levels. Thus a 

5 protocol may have zero or more children. Ethernet packets, for example, have several 
variants, each having a basic format that remains substantially the same. An Ethernet 
packet (the root or level 0 node) may be an Ethertype packet— also called an Ethernet 
Type/Version 2 and a DEC (DIGITAL-Intel-Xerox packet)— or an IEEE 803.2 packet. 
Continuing with the IEEE 802.3 packet, one of the children nodes may be the IP protocol, 

10 and one of the children of the TP protocol may be the TCP protocol. 

FIG. 16 shows the header 1600 (base level 1) of a complete Ethernet frame (Le., 
packet) of information and includes information on the destination media access control 
address (Dst MAC 1602) and the source media access control address (Src MAC 1604). 
Also shown in FIG. 16 is some (but not all) of the information specified in the PDL files 
15 for extraction the signature. 

FIG. 17A now shows the header information for the next level (level-2) for an 
Ethertype packet 1700. For an Ethertype packet 1700, the relevant information from the 
packet that indicates the next layer level is a two-byte type field 1702 containing the child 
recognition pattern for the next level. The remaining information 1704 is shown hatched 
20 because it not relevant for this level. The list 1712 shows the possible children for an 
Ethertype packet as indicated by what child recognition pattern is found offset 12. 
FIG. 17B shows the structure of the header of one of the possible next levels, that of the 
IP protocol. The possible children of the TP protocol are shown in table 1752. 

The pattern, parse, and extraction database (pattern recognition database, or PRD) 
25 308 generated by compilation process 3 10, in one embodiment, is in the form of a three 
dimensional structure that provides for rapidly searching packet headers for the next 
protocol FIG. 18A shows such a 3-D representation 1800 (which may be considered as 
an indexed set of 2-D representations). A compressed form of the 3-D structure is 
preferred. 

30 An alternate embodiment of the data structure used in database 308 is illustrated in 

FIG. 18B. Thus, like the 3-D structure of FIG. 18A, the data structure permits rapid 
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searches to be performed by the pattern recognition process 304 by indexing locations in a 
memory rather than performing address link computations. In this alternate embodiment, 
the PRD 308 includes two parts, a single protocol table 1850 (PT) which has an entry for 
each protocol known for the monitor, and a series of Look Up Tables 1870 (LUTs) that 

5 are used to identify known protocols and their children. The protocol table includes the 
parameters needed by the pattern analysis and recognition process 304 (implemented by 
PRE 1006) to evaluate the header information in the packet that is associated with that 
protocol, and parameters needed by extraction process 306 (implemented by slicer 1007) 
to process the packet header. When there are children, the PT describes which bytes in the 

10 header. to evaluate to determine the child protocol. In particular, each PT entry contains 
the header length, an offset to the child, a slicer command, and some flags. 

The pattern matching is carried out by finding particular "child recognition codes" 
in the header fields, and using these codes to index one or more of the LUTs. Each LUT 
entry has a node code that can have one of four values, indicating the protocol that has 
15 been recognized, a code to indicate that the protocol has been partially recognized (more 
LUT lookups are needed), a code to indicate that this is a terminal node, and a null node 
to indicate a null entry. The next LUT to lookup is also returned from a LUT lookup. 

Compilation process is described in FIG. 4. The source-code information in the 
form of protocol description files is shown as 402. In the particular embodiment, the high 
20 level decoding descriptions includes a set of protocol description files 336, one for each 
protocol, and a set of packet layer selections 338, which describes the particular layering 
(sets of trees of protocols) that the monitor is to be able to handle. 

A compiler 403 compiles the descriptions. The set of packet parse-and-extract 
operations 406 is generated (404), and a set of packet state instructions and operations 

25 407 is generated (405) in the form of instructions for the state processor that implements 
state processing process 328. Data files for each type of application and protocol to be 
recognized by the analyzer are downloaded from the pattern, parse, and extraction 
database 406 into the memory systems of the parser and extraction engines. (See the 
parsing process 500 description and FIG. 5; the extraction process 600 description and 

30 FIG. 6; and the parsing subsystem hardware description and FIG. 10). Data files for each 
type of application and protocol to be recognized by the analyzer are also downloaded 
from the state-processor instruction database 407 into the state processor, (see the state 
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processor 1108 description and FIG. 11.). 

Note that generating the packet parse and extraction operations builds and links 
the three dimensional structure (one embodiment) or the or all the lookup tables for the 
PRD. 

5 Because of the large number of possible protocol trees and subtrees, the compiler 

process 400 includes optimization that compares the trees and subtrees to see which 
children share common parents. When implemented in the form of the LUT's, this 
process can generate a single LUT from a plurality of LUT's. The optimization process 
further includes a compaction process that reduces the space needed to store the data of 

10 the PRD. 

As an example of compaction, consider the 3-D structure of FIG. 18A that can be 
thought of as a set of 2-D structures each representing a protocol. To enable saving space 
by using only one array per protocol which may have several parents, in one embodiment, 
the pattern analysis subprocess keeps a "current header" pointer. Each location (offset) 

15 index for each protocol 2-D array in the 3-D structure is a relative location starting with 
the start of header for the particular protocol. Furthermore, each of the two-dimensional 
arrays is sparse. The next step of the optimization, is checking all the 2-D arrays against 
all the other 2-D arrays to find out which ones can share memory. Many of these 2-D 
arrays are often sparsely populated in that they each have only a small number of valid 

20 entries. So, a process of "folding" is next used to combine two or more 2-D arrays 

together into one physical 2-D array without losing the identity of any of the original 2-D 
arrays (i.e., all the 2-D arrays continue to exist logically). Folding can occur between any 
2-D arrays irrespective of their location in the tree as long as certain conditions are met. 
Multiple arrays may be combined into a single array as long as the individual entries do 

25 not conflict with each other. A fold number is then used to associate each element with its 
original array. A similar folding process is used for the set of LUTs 1850 in the alternate 
embodiment of FIG. 18B. 

In 410, the analyzer has been initialized and is ready to perform recognition. 

FIG. 5 shows a flowchart of how actual parser subsystem 301 functions. Starting 
30 at 501, the packet 302 is input to the packet buffer in step 502. Step 503 loads the next 
(initially the first) packet component from the packet 302. The packet components are 
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extracted from each packet 302 one element at a time. A check is made (504) to determine 
if the load-packet-component operation 503 succeeded, indicating that there was more in 
the packet to process. If not, indicating all components have been loaded, the parser 
subsystem 301 builds the packet signature (512) — the next stage (FIG 6). 

5 If a component is successfully loaded in 503, the node and processes are fetched 

(505) from the pattern, parse and extraction database 308 to provide a set of patterns and 
processes for that node to apply to the loaded packet component. The parser subsystem 
301 checks (506) to determine if the fetch pattern node operation 505 completed 
successfully, indicating there was a pattern node that loaded in 505. If not, step 511 

10 moves to the next packet component. If yes, then the node and pattern matching process 
are applied in 507 to the component extracted in 503. A pattern match obtained in 507 (as 
indicated by test 508) means the parser subsystem 301 has found a node in the parsing 
elements; the parser subsystem 301 proceeds to step 509 to extract the elements. 

If applying the node process to the component does not produce a match (test 
15 508), the parser subsystem 301 moves (510) to the next pattern node from the pattern 
database 308 and to step 505 to fetch the next node and process. Thus, there is an 
"applying patterns" loop between 508 and 505. Once the parser subsystem 301 completes 
all the patterns and has either matched or not, the parser subsystem 301 moves to the next 
packet component (511). 

20 Once all the packet components have been the loaded and processed from the 

input packet 302, then the load packet will fail (indicated by test 504), and the parser 
subsystem 301 moves to build a packet signature which is described in FIG. 6 

FIG. 6 is a flow chart for extracting the information from which to build the 
packet signature. The flow starts at 601, which is the exit point 513 of FIG. 5. At this 

25 point parser subsystem 301 has a completed packet component and a pattern node 
available in a buffer (602). Step 603 loads the packet component available from the 
pattern analysis process of FIG. 5. If the load completed (test 604), indicating that there 
was indeed another packet component, the parser subsystem 301 fetches in 605 the 
extraction and process elements received from the pattern node component in 602. If the 

30 fetch was successful (test 606), indicating that there are extraction elements to apply, the 
parser subsystem 301 in step 607 applies that extraction process to the packet component 
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based on an extraction instruction received from that pattern node. This removes and 
saves an element from the packet component. 

In step 608, the parser subsystem 30 1 checks if there is more to extract from this 
component, and if not, the parser subsystem 301 moves back to 603 to load the next 
5 packet component at hand and repeats the process. If the answer is yes, then the parser 
subsystem 301 moves to the next packet component ratchet. That new packet component 
is then loaded in step 603. As the parser subsystem 301 moved through the loop between 
608 and 603, extra extraction processes are applied either to the same packet component if 
there is more to extract, or to a different packet component if there is no more to extract. 

10 The extraction process thus builds the signature, extracting more and more 

components according to the information in the patterns and extraction database 308 for 
the particular packet. Once loading the next packet component operation 603 fails (test 
604), all the components have been extracted. The built signature is loaded into the 
signature buffer (610) and the parser subsystem 301 proceeds to FIG. 7 to complete the 

15 signature generation process. 

Referring now to FIG. 7, the process continues at 701. The signature buffer and 
the pattern node elements are available (702). The parser subsystem 301 loads the next 
pattern node element. If the load was successful (test 704) indicating there are more 
nodes, the parser subsystem 301 in 705 hashes the signature buffer element based on the 
20 hash elements that are found in the pattern node that is in the element database. In 706 the 
resulting signature and the hash are packed. In 707 the parser subsystem 301 moves on to 
the next packet component which is loaded in 703. 

The 703 to 707 loop continues until there are no more patterns of elements left 
(test 704). Once all the patterns of elements have been hashed, processes 304, 306 and 
25 3 12 of parser subsystem 301 are complete. Parser subsystem 301 has generated the 
signature used by the analyzer subsystem 303. 

A parser record is loaded into the analyzer, in particular, into the UFKB in the 
form of a UFKB record which is similar to a parser record, but with one or more different 
fields. 

30 FIG. 8 is a flow diagram describing the operation of the lookup/update engine 

(LUE) that implements lookup operation 314. The process starts at 801 from FIG. 7 with 
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the parser record that includes a signature, the hash and at least parts of the payload. In 
802 those elements are shown in the form of a UFKB-entry in the buffer. The LUE, the 
lookup engine 314 computes a "record bin number" from the hash for a flow-entry. A bin 
herein may have one or more "buckets" each containing a flow-entry. The preferred 
5 embodiment has four buckets per bin. 

Since preferred hardware embodiment includes the cache, all data accesses to 
records in the flowchart of FIG. 8 are stated as being to or from the cache. 

Thus, in 804, the system looks up the cache for a bucket from that bin using the 
hash. If the cache successfully returns with a bucket from the bin number, indicating there 

10 are more buckets in the bin, the lookup/update engine compares (807) the current 
signature (the UFKB-entry' s signature) from that in the bucket (i.e., the flow-entry 
signature). If the signatures match (test 808), that record (in the cache) is marked in step 
810 as "in process" and a timestamp added. Step 811 indicates to the UFKB that the 
UFKB-entry in 802 has a status of "found." The "found" indication allows the state 

15 processing 328 to begin processing this UFKB element. The preferred hardware 

embodiment includes one or more state processors, and these can operate in parallel with 
the lookup/update engine. 

In the preferred embodiment, a set of statistical operations is performed by a 
calculator for every packet analyzed. The statistical operations may include one or more 

20 of counting the packets associated with the flow; determining statistics related to the size 
of packets of the flow; compiling statistics on differences between packets in each 
direction, for example using timestamps; and determining statistical relationships of 
timestamps of packets in the same direction. The statistical measures are kept in the flow- 
entries. Other statistical measures also may be compiled. These statistics may be used 

25 singly or in combination by a statistical processor component to analyze many different 
aspects of the flow. This may include determining network usage metrics from the 
statistical measures, for example to ascertain the network's ability to transfer information 
for this application. Such analysis provides for measuring the quality of service of a 
conversation, measuring how well an application is performing in the network, measuring 

30 network resources consumed by an application, and so forth. 

To provide for such analyses, the lookup/update engine updates one or more 



WO 01/01272 



PCT/US00/18330 



38 

counters that are part of the flow-entry (in the cache) in step 812. The process exits at 813. 
In our embodiment, the counters include the total packets of the flow, the time, and a 
differential time from the last timestamp to the present timestamp. 

It may be that the bucket of the bin did not lead to a signature match (test 808). In 
5 such a case, the analyzer in 809 moves to the next bucket for this bin. Step 804 again 
looks up the cache for another bucket from that bin. The lookup/update engine thus 
continues lookup up buckets of the bin until there is either a match in 808 or operation 
804 is not successful (test 805), indicating that there are no more buckets in the bin and no 
match was found. 

10 If no match was found, the packet belongs to a new (not previously encountered) 

flow. In 806 the system indicates that the record in the unified flow key buffer for this 
packet is new, and in 812, any statistical updating operations are performed for this packet 
by updating the flow-entry in the cache. The update operation exits at 813. A flow 
insertion/deletion engine (FIDE) creates a new record for this flow (again via the cache). 

15 Thus, the update/lookup engine ends with a UFKB-entry for the packet with a 

"new" status or a "found" status. 

Note that the above system uses a hash to which more than one flow-entry can 
match. A longer hash may be used that corresponds to a single flow-entry. In such an 
embodiment, the flow chart of FIG. 8 is simplified as would be clear to those in the art. 

20 The hardware system 

Each of the individual hardware elements through which the data flows in the 
system are now described with reference to FIGS. 10 and 1 1. Note that while we are 
describing a particular hardware implementation of the invention embodiment of FIG. 3, 
it would be clear to one skilled in the art that the flow of FIG. 3 may alternatively be 

25 implemented in software running on one or more general-purpose processors, or only 
partly implemented in hardware. An implementation of the invention that can operate in 
software is shown in FIG. 14. The hardware embodiment (FIGS. 10 and 1 1) can operate 
at over a million packets per second, while the software system of FIG. 14 may be 
suitable for slower networks. To one skilled in the art it would be clear that more and 

30 more of the system may be implemented in software as processors become faster. 
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FIG. 10 is a description of the parsing subsystem (301, shown here as subsystem 
1000) as implemented in hardware. Memory 1001 is the pattern recognition database 
memory, in which the patterns that are going to be analyzed are stored. Memory 1002 is 
the extraction-operation database memory, in which the extraction instructions are stored. 
5 Both 1001 and 1002 correspond to internal data structure 308 of FIG. 3. Typically, the 
system is initialized from a microprocessor (not shown) at which time these memories are 
loaded through a host interface multiplexor and control register 1005 via the internal 
buses 1003 and 1004. Note that the contents of 1001 and 1002 are preferably obtained by 
compiling process 310 of FIG. 3. 

10 A packet enters the parsing system via 1012 into a parser input buffer memory 

1008 using control signals 1021 and 1023, which control an input buffer interface 
controller 1022. The buffer 1008 and interface control 1022 connect to a packet 
acquisition device (not shown). The buffer acquisition device generates a packet start 
signal 1021 and the interface control 1022 generates a next packet (i.e., ready to receive 

15 data) signal 1023 to control the data flow into parser input buffer memory 1008. Once a 
packet starts loading into the buffer memory 1008, pattern recognition engine (PRE) 1006 
carries out the operations on the input buffer memory described in block 304 of FIG. 3. 
That is, protocol types and associated headers for each protocol layer that exist in the 
packet are determined. 

20 The PRE searches database 1001 and the packet in buffer 1008 in order to 

recognize the protocols the packet contains. In one implementation, the database 1001 
includes a series of linked lookup tables. Each lookup table uses eight bits of addressing. 
The first lookup table is always at address zero. The Pattern Recognition Engine uses a 
base packet offset from a control register to start the comparison. It loads this value into a 

25 current offset pointer (COP). It then reads the byte at base packet offset from the parser 
input buffer and uses it as an address into the first lookup table. 

Each lookup table returns a word that links to another lookup table or it returns a 
terminal flag. If the lookup produces a recognition event the database also returns a 
command for the sheer. Finally it returns the value to add to the COP. 

30 The PRE 1006 includes of a comparison engine. The comparison engine has a first 

stage that checks the protocol type field to determine if it is an 802.3 packet and the field 
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should be treated as a length. If it is not a length, the protocol is checked in a second 
stage. The first stage is the only protocol level that is not programmable. The second stage 
has two full sixteen bit content addressable memories (CAMs) defined for future protocol 
additions. 

5 Thus, whenever the PRE recognizes a pattern, it also generates a command for the 

extraction engine (also called a "slicer") 1007. The recognized patterns and the commands 
are sent to the extraction engine 1007 that extracts information from the packet to build 
the parser record. Thus, the operations of the extraction engine are those carried out in 
blocks 306 and 312 of FIG. 3. The commands are sent from PRE 1006 to slicer 1007 in 

10 the form of extraction instruction pointers which tell the extraction engine 1007 where to 
a find the instructions in the extraction operations database memory (i.e., slicer instruction 
database) 1002. 

Thus, when the PRE 1006 recognizes a protocol it outputs both the protocol 
identifier and a process code to the extractor. The protocol identifier is added to the flow 

15 signature and the process code is used to fetch the first instruction from the instruction 
database 1002. Instructions include an operation code and usually source and destination 
offsets as well as a length. The offsets and length are in bytes. A typical operation is the 
MOVE instruction/This instruction tells the slicer 1007 to copy n bytes of data 
unmodified from the input buffer 1008 to the output buffer 1010. The extractor contains a 

20 byte-wise barrel shifter so that the bytes moved can be packed into the flow signature. 
The extractor contains another instruction called HASH. This instruction tells the 
extractor to copy from the input buffer 1008 to the HASH generator. 

Thus these instructions are for extracting selected element(s) of the packet in the 
input buffer memory and transferring the data to a parser output buffer memory 1010. 
25 Some instructions also generate a hash. 

The extraction engine 1007 and the PRE operate as a pipeline. That is, extraction 
engine 1007 performs extraction operations on data in input buffer 1008 already 
processed by PRE 1006 while more (i.e., later arriving) packet information is being 
simultaneously parsed by PRE 1006. This provides high processing speed sufficient to 
30 accommodate the high arrival rate speed of packets. 

Once all the selected parts of the packet used to forin the signature are extracted, 
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the hash is loaded into parser output buffer memory 1010. Any additional payload from 
the packet that is required for further analysis is also included. The parser output memory 
1010 is interfaced with the analyzer subsystem by analyzer interface control 101 1. Once 
all the information of a packet is in the parser output buffer memory 1010, a data ready 
5 signal 1025 is asserted by analyzer interface control. The data from the parser subsystem 
1000 is moved to the analyzer subsystem via 1013 when an analyzer ready signal 1027 is 
asserted. 

FIG. 1 1 shows the hardware components and dataflow for the analyzer subsystem 
that performs the functions of the analyzer subsystem 303 of FIG. 3. The analyzer is 
10 initialized prior to operation, and initialization includes loading the state processing 
information generated by the compilation process 310 into a database memory for the 
state processing, called state processor instruction database (SPDD) memory 1 109. 

The analyzer subsystem 1 100 includes a host bus interface 1 122 using an analyzer 
host interface controller 1 1 18, which in turn has access to a cache system 1 1 15. The cache 
15 system has bi-directional access to and from the state processor of the system 1 108. State 
processor 1 108 is responsible for initializing the state processor instruction database 
memory 1 109 from information given over the host bus interface 1 122. 

With the SPID 1 109 loaded, the analyzer subsystem 1 100 receives parser records 
comprising packet signatures and payloads that come from the parser into the unified flow 
20 key buffer (UFKB) 1 103. UFKB is comprised of memory set up to maintain UFKB 

records. A UFKB record is essentially a parser record; the UFKB holds records of packets 
that are to be processed or that are in process. Furthermore, the UFKB provides for one or 
more fields to act as modifiable status flags to allow different processes to run 
concurrently. 

25 Three processing engines run concurrently and access records in the UFKB 1 103: 

the lookup/update engine (LUE) 1 107, the state processor (SP) 1 108, and the flow 
insertion and deletion engine (FIDE) 1110. Each of these is implemented by one or more 
finite state machines (FSNTs). There is bi-directional access between each of the finite 
state machines and the unified flow key buffer 1 103. The UFKB record includes a field 

30 that stores the packet sequence number, and another that is filled with state information in 
the form of a program counter for the state processor 1 108 that implements state 
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processing 328. The status flags of the UFKB for any entry includes that the LUE is done 
and that the LUE is transferring processing of the entry to the state processor. The LUE 
done indicator is also used to indicate what the next entry is for the LUE. There also is 
provided a flag to indicate that the state processor is done with the current flow and to 
5 indicate what the next entry is for the state processor. There also is provided a flag to 
indicate the state processor is transferring processing of the UFKB-entry to the flow 
insertion and deletion engine. 

A new UFKB record is first processed by the LUE 1 107. A record that has been 
processed by the LUE 1 107 may be processed by the state processor 1 108, and a UFKB 

10 record data may be processed by the flow insertion/deletion engine 1 1 10 after being 
processed by the state processor 1 108 or only by the LUE. Whether or not a particular 
engine has been applied to any unified flow key buffer entry is determined by status fields 
set by the engines upon completion. In one embodiment, a status flag in the UFKB-entry 
indicates whether an entry is new or found. In other embodiments, the LUE issues a flag 

15 to pass the entry to the state processor for processing, and the required operations for a 
new record are included in the SP instructions. 

Note that each UFKB-entry may not need to be processed by all three engines. 
Furthermore, some UFKB entries may need to be processed more than once by a 
particular engine. 

20 Each of these three engines also has bi-directional access to a cache subsystem 

1 1 15 that includes a caching engine. Cache 1 1 15 is designed to have information flowing 
in and out of it from five different points within the system: the three engines, external 
memory via a unified memory controller (UMC) 1 1 19 and a memory interface 1 123, and 
a microprocessor via analyzer host interface and control unit (ACIC) 1 1 18 and host 

25 interface bus (HIB) 1 122. The analyzer microprocessor (or dedicated logic processor) can 
thus directly insert or modify data in the cache. 

The cache subsystem 1 1 15 is an associative cache that includes a set of content 
addressable memory cells (CAMs) each including an address portion and a pointer 
portion pointing to the cache memory (e.g., RAM) containing the cached flow-entries. 
30 The CAMs are arranged as a stack ordered from a top CAM to a bottom CAM. The 
bottom CAM'S pointer points to the least recently used (LRU) cache memory entry. 
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Whenever there is a cache miss, the contents of cache memory pointed to by the bottom 
CAM are replaced by the flow-entry from the flow-entry database 324. This now becomes 
the most recently used entry, so the contents of the bottom CAM are moved to the top 
CAM and all CAM contents are shifted down. Thus, the cache is an associative cache 
5 with a true LRU replacement policy. 

The LUE 1 107 first processes a UFKB-entry, and basically performs the operation 
of blocks 314 and 3 16 in FIG. 3. A signal is provided to the LUE to indicate that a "new" 
UFKB-entry is available. The LUE uses the hash in the UFKB-entry to read a matching 
bin of up to four buckets from the cache. The cache system attempts to obtain the 
10 matching bin. If a matching bin is not in the cache, the cache 1115 makes the request to 
the UMC 1 1 19 to bring in a matching bin from the external memory. 

When a flow-entry is found using the hash, the LUE 1 107 looks at each bucket 
and compares it using the signature to the signature of the UFKB-entry until there is a 
match or there are no more buckets. 

15 If there is no match, or if the cache failed to provide a bin of flow-entries from the 

cache, a time stamp in set in the flow key of the UFKB record, a protocol identification 
and state determination is made using a table that was loaded by compilation process 3 10 
during initialization, the status for the record is set to indicate the LUE has processed the 
record, and an indication is made that the UFKB-entry is ready to start state processing. 

20 The identification and state determination generates a protocol identifier which in the 
preferred embodiment is a "jump vector" for the state processor which is kept by the 
UFKB for this UFKB-entry and used by the state processor to start state processing for 
the particular protocol. For example, the jump vector jumps to the subroutine for 
processing the state. 

25 If there was a match, indicating that the packet of the UFKB-entry is for a 

previously encountered flow, then a calculator component enters one or more statistical 
measures stored in the flow-entry, including the timestamp. In addition, a time difference 
from the last stored timestamp may be stored, and a packet count may be updated. The 
state of the flow is obtained from the flow-entry is examined by looking at the protocol 

30 identifier stored in the flow-entry of database 324. If that value indicates that no more 
classification is required, then the status for the record is set to indicate the LUE has 



WO 01/01272 



PCIYUSOO/18330 



44 

processed the record. In the preferred embodiment, the protocol identifier is a jump 
vector for the state processor to a subroutine to state processing the protocol, and no more 
classification is indicated in the preferred embodiment by the jump vector being zero. If 
the protocol identifier indicates more processing, then an indication is made that the 
5 UFKB-entry is ready to start state processing and the status for the record is set to indicate 
the LUE has processed the record. 

The state processor 1 108 processes information in the cache system according to a 
UFKB-entry after the LUE has completed. State processor 1 108 includes a state processor 
program counter SPPC that generates the address in the state processor instruction 

10 database 1 109 loaded by compiler process 310 during initialization. It contains an 

Instruction Pointer (SPIP) which generates the SPE> address. The instruction pointer can 
be incremented or loaded from a Jump Vector Multiplexor which facilitates conditional 
branching. The SPIP can be loaded from one of three sources: (1) A protocol identifier 
from the UFKB, (2) an immediate jump vector form the currently decoded instruction, or 

15 (3) a value provided by the arithmetic logic unit (SPALU) included in the state processor. 

Thus, after a Flow Key is placed in the UFKB by the LUE with a known protocol 
identifier, the Program Counter is initialized with the last protocol recognized by the 
Parser. This first instruction is a jump to the subroutine which analyzes the protocol that 
was decoded. 

20 The State Processor ALU (SPALU) contains all the Arithmetic, Logical and String 

Compare functions necessary to implement the State Processor instructions. The main 
blocks of the SPALU are: The A and B Registers, the Instruction Decode & State 
Machines, the String Reference Memory the Search Engine, an Output Data Register and 
an Output Control Register 

25 The Search Engine in turn contains the Target Search Register set, the Reference 

Search Register set, and a Compare block which compares two operands by exclusive-or- 
ing them together. 

Thus, after the UFKB sets the program counter, a sequence of one or more state 
operations are be executed in state processor 1 108 to further analyze the packet that is in 
30 the flow key buffer entry for this particular packet. 

FIG. 13 describes the operation of the state processor 1 108. The state processor is 
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entered at 1301 with a unified flow key buffer entry to be processed. The UFKB-entry is 
new or corresponding to a found flow-entry. This UFKB-entry is retrieved from unified 
flow key buffer 1 103 in 1301 . In 1303, the protocol identifier for the UFKB-entry is used 
. to set the state processor's instruction counter. The state processor 1 108 starts the process 
5 by using the last protocol recognized by the parser subsystem 301 as an offset into a jump 
table. The jump table takes us to the instructions to use for that protocol. Most 
instructions test something in the unified flow key buffer or the flow-entry if it exists. The 
state processor 1 108 may have to test bits, do comparisons, add or subtract to perform the 
test. 

10 The first state processor instruction is fetched in 1304 from the state processor 

instruction database memory 1 109. The state processor performs the one or more fetched 
operations (1304). In our implementation, each single state processor instruction is very 
primitive (e.g., a move, a compare, etc.), so that many such instructions need to be 
performed on each unified flow key buffer entry. One aspect of the state processor is its 

15 ability to search for one or more (up to four) reference strings in the pay load part of the 
UFKB entry. This is implemented by a search engine component of the state processor 
responsive to special searching instructions. 

In 1307, a check is made to determine if there are any more instructions to be 
performed for the packet. If yes, then in 1308 the system sets the state processor 
20 instruction pointer (SPIP) to obtain the next instruction. The SPIP may be set by an 

immediate jump vector in the currently decoded instruction, or by a value provided by the 
SPALU during processing. 

The next instruction to be performed is now fetched (1304) for execution. This 
state processing loop between 1304 and 1307 continues until there are no more 
25 instructions to be performed. 

At this stage, a check is made in 1309 if the processing on this particular packet 
has resulted in a final state. That is, is the analyzer is done processing not only for this 
particular packet, but for the whole flow to which the packet belongs, and the flow is fully 
determined. If indeed there are no more states to process for this flow, then in 13 1 1 the 
30 processor finalizes the processing. Some final states may need to put a state in place that 
tells the system to remove a flow — for example, if a connection disappears from a lower 
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level connection identifier. In that case, in 131 1, a flow removal state is set and saved in 
the flow-entry. The flow removal state may be a NOP (no-op) instruction which means 
there are no removal instructions. 

Once the appropriate flow removal instruction as specified for this flow (a NOP or 
5 otherwise) is set and saved, the process is exited at 1313. The state processor 1 108 can 
now obtain another unified flow key buffer entry to process. 

If at 1309 it is determined that processing for this flow is not completed, then in 
1310 the system saves the state processor instruction pointer in the current flow-entry in 
the current flow-entry. That will be the next operation that will be performed the next 
10 time the LRE 1 107 finds packet in the UFKB that matches this flow. The processor now 
exits processing this particular unified flow key buffer entry at 1313. 

Note that state processing updates information in the unified flow key buffer 1 103 
and the flow-entry in the cache. Once the state processor is done, a flag is set in the 
UFKB for the entry that the state processor is done. Furthermore, If the flow needs to be 
15 inserted or deleted from the database of flows, control is then passed on to the flow 
insertion/deletion engine 1 1 10 for that flow signature and packet entry. This is done by 
the state processor setting another flag in the UFKB for this UFKB-entry indicating that 
the state processor is passing processing of this entry to the flow insertion and deletion 
engine. 

20 The flow insertion and deletion engine 1 1 10 is responsible for maintaining the 

flow-entry database. In particular, for creating new flows in the flow database, and 
deleting flows from the database so that they can be reused. 

The process of flow insertion is now described with the aid of FIG. 12. Rows are 
grouped into bins of buckets by the hash value. The engine processes a UFKB-entry that 

25 may be new or that the state processor otherwise has indicated needs to be created. 
FIG. 12 shows the case of a new entry being created. A conversation record bin 
(preferably containing 4 buckets for four records) is obtained in 1203. This is a bin that 
matches the hash of the UFKB, so this bin may already have been sought for the UFKB- 
entry by the LUE. In 1204 the FIDE 1 1 10 requests that the record bin/bucket be 

30 maintained in the cache system 1 1 15. If in 1205 the cache system 1 1 15 indicates that the 
bin/bucket is empty, step 1207 inserts the flow signature (with the hash) into the bucket 
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and the bucket is marked "used" in the cache engine of cache 1115 using a timestamp that 
is maintained throughout the process. In 1209, the FIDE 1110 compares the bin and 
bucket record flow signature to the packet to verify that all the elements are in place to 
complete the record. In 121 1 the system marks the record bin and bucket as "in process" 
5 and as "new" in the cache system (and hence in the external memory). In 1212, the initial 
statistical measures for the flow-record are set in the cache system. This in the preferred 
embodiment clears the set of counters used to maintain statistics, and may perform other 
procedures for statistical operations requires by the analyzer for the first packet seen for a 
particular flow. 

10 Back in step 1205, if the bucket is not empty, the FIDE 1110 requests the next 

bucket for this particular bin in the cache system. If this succeeds, the processes of 1207, 
1209, 121 1 and 1212 are repeated for this next bucket. If at 1208, there is no valid bucket, 
the unified flow key buffer entry for the packet is set as "drop," indicating that the system 
cannot process the particular packet because there are no buckets left in the system. The 

15 process exits at 1213. The FIDE 1 1 10 indicates to the UFKB that the flow insertion and 
deletion operations are completed for this UFKB-entry. This also lets the UFKB provide 
the FIDE with the next UFKB record. 

Once a set of operations is performed on a unified flow key buffer entry by all of 
the engines required to access and manage a particular packet and its flow signature, the 
20 unified flow key buffer entry is marked as "completed." That element will then be used 
by the parser interface for the next packet and flow signature coming in from the parsing 
and extracting system. 

All flow-entries are maintained in the external memory and some are maintained 
in the cache 1115. The cache system 1 1 15 is intelligent enough to access the flow 

25 database and to understand the data structures that exists on the other side of memory 
interface 1 123. The lookup/update engine 1 107 is able to request that the cache system 
pull a particular flow or "buckets" of flows from the unified memory controller 1119 into 
the cache system for further processing. The state processor 1 108 can operate on 
information found in the cache system once it is looked up by means of the lookup/update 

30 engine request, and the flow insertion/deletion engine 1 1 10 can create new entries in the 
cache system if required based on information in the unified flow key buffer 1 103. The 
cache retrieves information as required from the memory through the memory interface 
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1 123 and the unified memory controller 1 1 19, and updates information as required in the 
memory through the memory controller 1119. 

There are several interfaces to components of the system external to the module of 
FIG. 1 1 for the particular hardware implementation. These include host bus interface 
1 122,which is designed as a generic interface that can operate with any kind of external 
processing system such as a microprocessor or a multiplexor (MUX) system. 
Consequently, one can connect the overall traffic classification system of FIGS. 1 1 and 12 
into some other processing system to manage the classification system and to extract data 
gathered by the system. 

The memory interface 1 123 is designed to interface to any of a variety of memory 
systems that one may want to use to store the flow-entries. One can use different types of 
memory systems like regular dynamic random access memory (DRAM), synchronous 
DRAM, synchronous graphic memory (SGRAM), static random access memory (SRAM), 
and so forth. 

PIG. 10 also includes some "generic" interfaces. There is a packet input interface 
1012— a general interface that works in tandem with the signals of the input buffer 
interface control 1022. These are designed so that they can be used with any kind of 
generic systems that can then feed packet information into the parser. Another generic 
interface is the interface of pipes 1031 and 1033 respectively out of and into host interface 
multiplexor and control registers 1005. This enables the parsing system to be managed by 
an external system, for example a microprocessor or another kind of external logic, and 
enables the external system to program and otherwise control the parser. 

The preferred embodiment of this aspect of the invention is described in a 
hardware description language (HDL) such as VHDL or Verilog. It is designed and 
; created in an HDL so that it may be used as a single chip system or, for instance, 

integrated into another general-purpose system that is being designed for purposes related 
to creating and analyzing traffic within a network. Verilog or other HDL implementation 
is only one method of describing the hardware. 

In accordance with one hardware implementation, the elements shown in FIGS. 10 
0 and 1 1 are implemented in a set of six field programmable logic arrays (FPGA's). The 
boundaries of these FPGA's are as Mows. The parsing subsystem of FIG. 10 is 
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implemented as two FPGAS; one FPGA, and includes blocks 1006, 1008 and 1012, parts 
of 1005, and memory 1001. The second FPGA includes 1002, 1007, 1013, 101 1 parts of 
1005. Referring to FIG. 1 1, the unified look-up buffer 1 103 is implemented as a single 
FPGA. State processor 1 108 and part of state processor instruction database memory 
5 1 109 is another FPGA. Portions of the state processor instruction database memory 1 109 
are maintained in external SRAM's. The lookup/update engine 1 107 and the flow 
insertion/deletion engine 1 1 10 are in another FPGA. The sixth FPGA includes the cache 
system 1 1 15, the unified memory control 1 1 19, and the analyzer host interface and 
control 1118. 

10 Note that one can implement the system as one or more VSLI devices, rather than 

as a set of application specific integrated circuits (ASIC's) such as FPGA's. It is 
anticipated that in the future device densities will continue to increase, so that the 
complete system may eventually form a sub-unit (a "core") of a larger single chip unit. 

Operation of the Invention 

15 Fig. 15 shows how an embodiment of the network monitor 300 might be used to 

analyze traffic in a network 102. Packet acquisition device 1502 acquires all the packets 
from a connection point 121 on network 102 so that all packets passing point 121 in either 
direction are supplied to monitor 300. Monitor 300 comprises the parser sub-system 301, 
which determines flow signatures, and analyzer sub-system 303 that analyzes the flow 

20 signature of each packet. A memory 324 is used to store the database of flows that are 
determined and updated by monitor 300. A host computer 1504, which might be any 
processor, for example, a general-purpose computer, is used to analyze the flows in 
memory 324. As is conventional, host computer 1504 includes a memory, say RAM, 
shown as host memory 1506. In addition, the host might contain a disk. In one 

25 application, the system can operate as an RMON probe, in which case the host computer 
is coupled to a network interface card 1510 that is connected to the network 102. 

The preferred embodiment of the invention is supported by an optional Simple 
Network Management Protocol (SNMP) implementation. Fig. 15 describes how one 
would, for example, implement an RMON probe, where a network interface card is used 
30 to send RMON information to the network. Commercial SNMP implementations also are 
available, and using such an implementation can simplify the process of porting the 



WO 01/01272 



PCIYUSOO/18330 



50 

preferred embodiment of the invention to any platform. 

In addition, MIB Compilers are available. An MB Compiler is a tool that greatly 
simplifies the creation and maintenance of proprietary MIB extensions. 

Examples of Packet Elucidation 

5 Monitor 300, and in particular, analyzer 303 is capable of carrying out state 

analysis for packet exchanges that are commonly referred to as "server announcement" 
type exchanges. Server announcement is a process used to ease communications between 
a server with multiple applications that can all be simultaneously accessed from multiple 
clients. Many applications use a server announcement process as a means of multiplexing 

10 a single port or socket into many applications and services. With this type of exchange, 
messages are sent on the network, in either a broadcast or multicast approach, to 
announce a server and application, and all stations in the network may receive and decode 
these messages. The messages enable the stations to derive the appropriate connection 
point for communicating that particular application with the particular server. Using the 

15 server announcement method, a particular application communicates using a service 

channel, in the form of a TCP or UDP socket or port as in the IP protocol suite, or using a 
SAP as in the Novell IPX protocol suite. 

The analyzer 303 is also capable of carrying out "in-stream analysis" of packet 
exchanges. The "in-stream analysis" method is used either as a primary or secondary 

20 recognition process. As a primary process, in-stream analysis assists in extracting detailed 
information which will be used to further recognize both the specific application and 
application component. A good example of in-stream analysis is any Web-based 
application. For example, the commonly used PointCast Web information application can 
be recognized using this process; during the initial connection between a PointCast server 

25 and client, specific key tokens exist in the data exchange that will result in a signature 
being generated to recognize PointCast. 

The in-stream analysis process may also be combined with the server 
announcement process. In many cases in-stream analysis will augment other recognition 
processes. An example of combining in-stream analysis with server announcement can be 
30 found in business applications such as SAP and BAAN. 

"Session tracking" also is known as one of the primary processes for tracking 
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applications in client/server packet exchanges. The process of tracking sessions requires 
an initial connection to a predefined socket or port number. This method of 
communication is used in a variety of transport layer protocols. It is most commonly seen 
in the TCP and UDP transport protocols of the IP protocol. 

5 During the session tracking, a client makes a request to a server using a specific 

port or socket number. This initial request will cause the server to create a TCP or UDP 
port to exchange the remainder of the data between the client and the server. The server 
then replies to the request of the client using this newly created port. The original port 
used by the client to connect to the server will never be used again during this data 

10 exchange. 

One example of session tracking is TFTP (Trivial File Transfer Protocol), a 
version of the TCP/IP FTP protocol that has no directory or password capability. During 
the client/server exchange process of TFTP, a specific port (port number 69) is always 
used to initiate the packet exchange. Thus, when the client begins the process of 

15 communicating, a request is made to UDP port 69. Once the server receives this request, a 
new port number is created on the server. The server then replies to the client using the 
new port. In this example, it is clear that in order to recognize TFTP; network monitor 
300 analyzes the initial request from the client and generates a signature for it. Monitor 
300 uses that signature to recognize the reply. Monitor 300 also analyzes the reply from 

20 the server with the key port information, and uses this to create a signature for monitoring 
the remaining packets of this data exchange. 

Network monitor 300 can also understand the current state of particular 
connections in the network. Connection-oriented exchanges often benefit from state 
tracking to correctly identify the application. An example is the common TCP transport 

25 protocol that provides a reliable means of sending information between a client and a 
server. When a data exchange is initiated, a TCP request for synchronization message is 
sent. This message contains a specific sequence number that is used to track an 
acknowledgement from the server. Once the server has acknowledged the synchronization 
request, data may be exchanged between the client and the server. When communication 

30 is no longer required, the client sends a finish or complete message to the server, and the 
server acknowledges this finish request with a reply containing the sequence numbers 
from the request. The states of such a connection-oriented exchange relate to the various 
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types of connection and maintenance messages. 

Server Announcement Example 

The individual methods of server announcement protocols vary. However, the 
basic underlying process remains similar. A typical server announcement message is sent 

5 to one or more clients in a network. This type of announcement message has specific 
content, which, in another aspect of the invention, is salvaged and maintained in the 
database of flow-entries in the system. Because the announcement is sent to one or more 
stations, the client involved in a future packet exchange with the server will make an 
assumption that the information announced is known, and an aspect of the inventive 

l o monitor is that it too can make the same assumption. 

Sun-RPC is the implementation by Sun Microsystems, Inc. (Palo Alto, California) 
of the Remote Procedure Call (RPC), a programming interface that allows one program to 
use the services of another on a remote machine. A Sun-RPC example is now used to 
explain how monitor 300 can capture server announcements. 

15 A remote program or client that wishes to use a server or procedure must establish 

a connection, for which the RPC protocol can be used. 

Each server running the Sun-RPC protocol must maintain a process and database 
called the port Mapper. The port Mapper creates a direct association between a Sun-RPC 
program or application and a TCP or UDP socket or port (for TCP or UDP 

20 implementations). An application or program number is a 32-bit unique identifier 
assigned by ICANN (the Internet Corporation for Assigned Names and Numbers, 
www.icann.org) , which manages the huge number of parameters associated with Internet 
protocols (port numbers, router protocols, multicast addresses, etc.) Each port Mapper on 
a Sun-RPC server can present the mappings between a unique program number and a 

25 specific transport socket through the use of specific request or a directed announcement. 
According to ICANN, port number 1 1 1 is associated with Sun RPC. 

As an example, consider a client (e.g., CLIENT 3 shown as 106 in FIG. 1) making 
a specific request to the server (e.g., SERVER 2 of FIG. 1, shown as 110) on a predefined 
UDP or TCP socket. Once the port Mapper process on the sun RPC server receives the 
30 request, the specific mapping is returned in a directed reply to the client. 
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1. A client (CLIENT 3, 106 in FIG. 1) sends a TCP packet to SERVER 2 
(1 10 in FIG. 1) on port 1 11, with an RPC Bind Lookup Request 
(rpcBindLookup). TCP or UDP port 1 1 1 is always associated Sun RPC. This 
request specifies the program (as a program identifier), version, and might 

5 specify the protocol (UDP or TCP). 

2. The server SERVER 2 (1 10 in FIG. 1 ) extracts the program identifier and 
version identifier from the request. The server also uses the fact that this 
packet came in using the TCP transport and that no protocol was specified, and 
thus will use the TCP protocol for its reply. 

10 3. The server 1 10 sends a TCP packet to port number 1 1 1, with an RPC Bind 

Lookup Reply. The reply contains the specific port number (e.g., port number 
'port') on which future transactions will be accepted for the specific RPC 
program identifier (e.g., Program 'program') and the protocol (UDP or TCP) 
for use. 

15 It is desired that from now on every time that port number 'port' is used, the 

packet is associated with the application program 'program' until the number 'port' no 
longer is to be associated with the program 'program'. Network monitor 300 by creating a 
flow-entry and a signature includes a mechanism for remembering the exchange so that 
future packets that use the port number 'port' will be associated by the network monitor 

20 with the application program 'program'. 

In addition to the Sun RPC Bind Lookup request and reply, there are other ways 
that a particular program — say 'program'— might be associated with a particular port 
number, for example number 'port'. One is by a broadcast announcement of a particular 
association between an application service and a port number, called a Sun RPC 

25 portMapper Announcement. Another, is when some server — say the same SERVER 2 — 
replies to some client — say CLIENT 1 — requesting some portMapper assignment with a 
RPC portMapper Reply. Some other client — say CLIENT 2 — might inadvertently see this 
request, and thus know that for this particular server, SERVER 2, port number 'port' is 
associated with the application service 'program'. It is desirable for the network monitor 

30 300 to be able to associate any packets to SERVER 2 using port number 'port' with the 
application program 'program'. 
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FIG. 9 represents a dataflow 900 of some operations in the monitor 300 of FIG. 3 
for Sun Remote Procedure Call. Suppose a client 106 (e.g., CLIENT 3 in FIG. 1) is 
communicating via its interface to the network 1 18 to a server 110 (e.g., SERVER 2 in 
FIG. 1) via the server's interface to the network 1 16. Further assume that Remote 
5 Procedure Call is used to communicate with the server 1 10. One path in the data flow 900 
starts with a step 910 that a Remote Procedure Call bind lookup request is issued by client 
106 and ends with the server state creation step 904. Such RPC bind lookup request 
includes values for the 'program,' 'version,' and 'protocol' to use, e.g., TCP or UDP. The 
process for Sun RPC analysis in the network monitor 300 includes the following aspects. : 

10 • Process 909: Extract the 'program,' 'version,' and 'protocol' (UDP or TCP). 

Extract the TCP or UDP port (process 909) which is 1 1 1 indicating Sun RPC. 

t 

r 

• Process 908: Decode the Sun RPC packet. Check RPC type field for ID. If 
value is portMapper, save paired socket (i.e., dest for destination address, src 
for source address). Decode ports and mapping, save ports with socket/addr 
15 key. There may be more than one pairing per mapper packet. Form a signature 

(e.g., a key). A flow-entry is created in database 324. The saving of the request 
is now complete. 

At some later time, the server (process 907) issues a RPC bind lookup reply. The 
packet monitor 300 will extract a signature from the packet and recognize it from the 
20 previously stored flow. The monitor will get the protocol port number (906) and lookup 
the request (905). A new signature (i.e., a key) will be created and the creation of the 
server state (904) will be stored as an entry identified by the new signature in the flow- 
entry database. That signature now may be used to identify packets associated with the 
server. 

25 The server state creation step 904 can be reached not only from a Bind Lookup 

Request/Reply pair, but also from a RPC Reply portMapper packet shown as 901 or an 
RPC Announcement portMapper shown as 902. The Remote Procedure Call protocol can 
announce that it is able to provide a particular application service. Embodiments of the 
present invention preferably can analyze when an exchange occurs between a client and a 

30 server, and also can track those stations that have received the announcement of a service 
in the network. 
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The RPC Announcement portMapper announcement 902 is a broadcast. Such 
causes various clients to execute a similar set of operations, for example, saving the 
information obtained from the announcement. The RPC Reply portMapper step 901 could 
be in reply to a portMapper request, and is also broadcast. It includes all the service 
5 parameters. 

Thus monitor 300 creates and saves all such states for later classification of flows 
that relate to the particular service 'program'. 

FIG. 2 shows how the monitor 300 in the example of Sun RPC builds a signature 
and flow states. A plurality of packets 206-209 are exchanged, e.g., in an exemplary Sun 
10 Microsystems Remote Procedure Call protocol. A method embodiment of the present 
invention might generate a pair of flow signatures, "signature- 1" 210 and "signature-2" 
212, from information found in the packets 206 and 207 which, in the example, 
correspond to a Sun RPC Bind Lookup request and reply, respectively. 

Consider first the Sun RPC Bind Lookup request. Suppose packet 206 corresponds 
15 to such a request sent from CLIENT 3 to SERVER 2. This packet contains important 
information that is used in building a signature according to an aspect of the invention. A 
source and destination network address occupy the first two fields of each packet, and 
according to the patterns in pattern database 308, the flow signature (shown as KEY1 230 
in FIG. 2) will also contain these two fields, so the parser subsystem 301 will include 
20 these two fields in signature KEY 1 (230). Note that in FIG. 2, if an address identifies the 
client 106 (shown also as 202), the label used in the drawing is "Cj". If such address 
identifies the server 1 10 (shown also as server 204), the label used in the drawing is "Sj". 
The first two fields 214 and 215 in packet 206 are "Sj" and Cj" because packet 206 is 
provided from the server 110 and is destined for the client 106. Suppose for this example, 
25 "Sj" is an address numerically less than address "Cf*. A third field "p 1 " 216 identifies the 
particular protocol being used, e.g., TCP, UDP, etc. 

In packet 206, a fourth field 217 and a fifth field 218 are used to communicate 
port numbers that are used. The conversation direction determines where the port number 
field is. The diagonal pattern in field 217 is used to identify a source-port pattern, and the 
30 hash pattern in field 218 is used to identify the destination-port pattern. The order 

indicates the client-server message direction. A sixth field denoted "i 1 " 219 is an element 
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that is being requested by the client from the server. A seventh field denoted u s 1 a" 220 is 
the service requested by the client from server 1 10. The following eighth field U QA" 221 
(for question mark) indicates that the client 106 wants to know what to use to access 
application "sja". A tenth field "QP" 223 is used to indicate that the client wants the 
5 server to indicate what protocol to use for the particular application. 

Packet 206 initiates the sequence of packet exchanges, e.g., a 
RPC Bind Lookup Request to SERVER 2. It follows a well-defined format, as do all the 
packets, and is transmitted to the server 1 10 on a well-known service connection identifier 
(port 1 1 1 indicating Sun RPC). 

10 Packet 207 is the first sent in reply to the client 106 from the server. It is the 

RPC Bind Lookup Reply as a result of the request packet 206. 

Packet 207 includes ten fields 224-233. The destination and source addresses are 
carried in fields 224 and 225, e.g., indicated "Cf and "Sf, respectively. Notice the order 
is now reversed, since the client-server message direction is from the server 1 10 to the 
15 client 106. The protocol "p 1 " is used as indicated in field 226. The request "i 1 " is in field 
229. Values have been filled in for the application port number, e.g., in field 233 and 
protocol ""p2"" in field 233. 

The flow signature and flow states built up as a result of this exchange are now 
described. When the packet monitor 300 sees the request packet 206 from the client, a 

20 first flow signature 210 is built in the parser subsystem 301 according to the pattern and 
extraction operations database 308. This signature 210 includes a destination and a source 
address 240 and 24 1 . One aspect of the invention is that the flow keys are built 
consistently in a particular order no matter what the direction of conversation. Several 
mechanisms may be used to achieve this. In the particular embodiment, the numerically 

25 lower address is always placed before the numerically higher address. Such least to 
highest order is used to get the best spread of signatures and hashes for the lookup 
operations. In this case, therefore, since we assume "SfVCj", the order is address "Sf 
followed by client address "Cj". The next field used to build the signature is a protocol 
field 242 extracted from packet 206's field 216, and thus is the protocol "p 1 ". The next 

30 field used for the signature is field 243, which contains the destination source port number 
shown as a crosshatched pattern from the field 218 of the packet 206. This pattern will be 
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recognized in the payload of packets to derive how this packet or sequence of packets 
exists as a flow. In practice, these may be TCP port numbers, or a combination of TCP 
port numbers. In the case of the Sun RPC example, the Crosshatch represents a set of port 
numbers of UDS for p 1 that will be used to recognize this flow (e.g., port 111). Port 1 1 1 
5 indicates this is Sun RPC. Some applications, such as the Sun RPC Bind Lookups, are 
directly determinable ("known") at the parser level. So in this case, the signature KEY-1 
points to a known application denoted "a 1 " (Sun RPC Bind Lookup), and a next-state that 
the state processor should proceed to for more complex recognition jobs, denoted as state 
"st D " is placed in the field 245 of the flow-entry. 

10 When the Sun RPC Bind Lookup reply is acquired, a flow signature is again built 

by the parser. This flow signature is identical to KEY-1. Hence, when the signature enters 
the analyzer subsystem 303 from the parser subsystem 301, the complete flow-entry is 
obtained, and in this flow-entry indicates state "st D '\ The operations for state "st D " in the 
state processor instruction database 326 instructs the state processor to build and store a 

15 new flow signature, shown as KEY-2 (212) in FIG. 2. This flow signature built by the 
state processor also includes the destination and a source addresses 250 and 25 1, 
respectively, for server "Sj" followed by (the numerically higher address) client "C{\ A 

protocol field 252 defines the protocol to be used, e.g., "p 2 " which is obtained from the 
reply packet. A field 253 contains a recognition pattern also obtained from the reply 

20 packet. In this case, the application is Sun RPC, and field 254 indicates this application 
"a 2 ". A next-state field 255 defines the next state that the state processor should proceed 
to for more complex recognition jobs, e.g., a state "st 1 ". In this particular example, this is 
a final state. Thus, KEY-2 may now be used to recognize packets that are in any way 
associated with the application "a 2 ". Two such packets 208 and 209 are shown, one in 

25 each direction. They use the particular application service requested in the original Bind 
Lookup Request, and each will be recognized because the signature KEY-2 will be built 
in each case. 

The two flow signatures 210 and 212 always order the destination and source 
address fields with server "Sj" followed by client "C{\ Such values are automatically 
30 filled in when the addresses are first created in a particular flow signature. Preferably, 



„,« «, «n PCT/US00/18330 
WO 01/01272 

58 

large collections of flow signatures are kept in a lookup table in a least-to-highest order 
for the best spread of flow signatures and hashes. 

Thereafter, the client and server exchange a number of packets, e.g., represented 
by request packet 208 and response packet 209. The client 106 sends packets 208 that 
5 have a destination and source address S , and C , , in a pair of fields 260 and 26 1 . A field 
262 defines the protocol as "p 2 ", and a field 263 defines the destination port number. 

Some network-server application recognition jobs are so simple that only a single 
state transition has to occur to be able to pinpoint the application that produced the packet. 
Others require a sequence of state transitions to occur in order to match a known and 
10 predefined climb from state-to-state. 

Thus the flow signature for the recognition of application "a 2 " is automatically set 
up by predefining what packet-exchange sequences occur for this example when a 
relatively simple Sun Microsystems Remote Procedure Call bind lookup request 
instruction executes. More complicated exchanges than this may generate more than two 
15 flow signatures and their corresponding states. Each recognition may involve setting up a 
complex state transition diagram to be traversed before a "final" resting state such as "st," 
in field 255 is reached. All these are used to build the final set of flow signatures for 
recognizing a particular application in the future. 

The State Processor in Detail 

20 The state processor 1 108 analyzes both new and existing flows in order to classify 

them by application. It does this by proceeding from state to state based on rules defined 
by the engineer. A rule is a test followed by the next state to proceed to if the test is true. 
The state processor 1 108 goes through each rule until the test is true or there are no more 
tests to perform. The state processor 1108 starts the process by using the last protocol 

25 recognized by parser subsystem 1000 as an offset into a jump table (the jump vector). The 
jump table takes us to the instructions to use for that protocol. Most instructions test 
something in the unified flow key buffer 1 103 or the flow-entry if it exists. The state 
processor 1 108 may have to test bits, do comparisons, add or subtract to perform the test. 

In most common processing systems, the set of instructions implemented are 
30 general purpose in nature. All processing systems have a typical set of instructions related 
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to the analysis and manipulation of the Instruction and program counters. These 
instructions include Jump, Call and Return. In addition, these same processing systems 
contain the appropriate instructions to analyze and manipulate registers and memory 
locations. These instructions include Increment, Decrement and Move, Compare and 
5 Logical manipulation. 

The state processor 1 108 of the preferred embodiment also includes such a basic 
set of standard instructions. However, the preferred embodiment state processor 1 108 has 
some very specific functions that are required in order to evaluate the content of and data 
within packets on networks. There are four specific functions performed by the preferred 

10 embodiment state processor to meet these objectives. Two of these are specialized 

conversion instructions designed to interpret and transpose text elements in a specific for 
into a mathematical and numerical format. These instructions are AH2B (ASCII 
Hexadecimal to Binary) and AD2D (ASCII Decimal to Binary). These instructions are 
single cycle in nature. These instructions are novel and included to provide for the time 

15 sensitive nature of the functions performed by the preferred embodiment state processor. 

In order to have the system make speed and meet the objective for classification, 
there are several other special functions provided in the State Processor. These functions 
primarily deal with seeking, locating, analyzing and evaluating sequences of strings. 
These strings can be either formatted or unformatted. 

20 The primary high level instructions are the in_Find and in_Find_coNTlNUE 

instructions, and are implemented by a searching apparatus (search engine) that is part of 
the state processor. These functions and the searching apparatus have been designed to 
make the state processor 1 108 capable of simultaneous searching payload content from a 
packet sent into the monitor 300. This enables the monitor to scale and meet any network 

25 speed requirements. 

The state processor is shown in FIG. 19 as processor 1 108. It executes its 
instructions from the state processor instruction database (SPID) 1 109 which if filled by 
the host CPU as part of the compilation process 310. The SP 1 108 contains several sub 
blocks including a program counter 1903 (SPPC) a control block 1905 (SPCB), an 
30 arithmetic logic unit 1907 (SPALU), address generators and data bus multiplexors 

(Muxes) to enable the movement of data from various sources to various destinations. The 
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two address generators are a SP flow key address generator 191 1 (SPFKAG) that points 
to the UFKB and a SP flow-entry address generator 1913 (SPFEAG) that points to the 
cache subsystem 1115. The SP 1 108 also includes four data Muxes: SP ALU Data Mux A 
1919, SP ALU Data Mux B 1921, SP UFKB Data Mux 1915, and SP Cache Data Mux 
5 1917. These Muxes facilitate the movement of data within the various blocks of the state 
processor 1 108 and to/from the UFKB 1 103 and the cache subsystem 1115. 

The SP control block 1905 decodes instructions coming out of the SPID 1 109 and 
separates them into various fields to control the state processor 1 108. The main function 
of the SPCB 1905 is instruction decoding and control signal generation. There are two 
10 classes of instructions. One that are executed completely by the SPCB and one that are 
passed along to the SPALU 1907 for partial or complete execution. Some of the SP 
instructions are described herein below. 

When an instruction needs to be passed to the SPALU 1907, the SPCB 1905 
decodes the instruction and supplies the SPALU 1907 instruction code on a bus and 
15 asserts a "Go" signal. 

When an instruction, e.g., a move or jump instruction, can be completely executed 
by the SPCB 1905, the SPCB generates the appropriate control signals to the SP program 
counter 1903, SP Address Generators 191 1 and/or 1913, and the SP Muxes in order to 
implement the specific move or jump instruction. 

20 Words in the SPED 1 109 are 40 bits long and partitioned into various fields by the 

SPCB 1905 depending on the instruction code. One field is the instruction code. The 
remaining bits in the SPID word is partitioned into various fields depending on the 
accompanying instruction. For example, the SP 1 108 can implement Jump, Call, Wait, 
and WaitRJ instructions that are followed by a condition code and a jump address. The SP 

25 1 108 also can execute a Move Immediate instruction that is followed by the constant 
value. Furthermore, SP 1008 can execute Load Address Generator instructions that are 
followed by the address to be loaded. Upon decoding the instruction field, the SPCB 
generates a combination of control signals from an included decode PAL. These control 
signals select the various Muxes that facilitate data movement and generate strobe signals 

30 that load values in various registers. 

The program counter SPPC 1903 generates the address to the state processor 
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instruction database. It contained an instruction pointer that generates the SPID 1 109 
address. The instruction pointer can be incremented or loaded from a jump vector 
multiplexor that facilitates conditional branching. The instruction pointer can be loaded 
from one of three sources: (1) a protocol identifier from the UFKB, (2) an immediate 
5 jump vector form the currently decoded instruction or (3) a value provided by the SPALU 
1907. 

After a flow signature is placed in the UFKB by the LUE with a known protocol 
identifier, the program counter 1903 is initialized with the last protocol recognized by the 
parser subsystem. This first instruction is a jump to the subroutine that analyzes the 
10 protocol that was decoded. 

In order to facilitate JUMP immediate instructions, the program counter takes an 
input field from the SPCB 1905 with the jump vector and loads the instruction pointer 
with the jump vector. 

The state processor ALU 1907 contains all the arithmetic, logical and string 
15 compare functions necessary to implement the state processor instructions. The main 
blocks of the SP ALU 1907 are: an A register and a B register, instruction decode & state 
machines, a reference string memory, a search engine 1930, an output data register and an 
output control register. 

The state processor ALU search engine 1930 (SPALUJ5E) in turn contains a 
20 target search register set, a reference search register set, and a compare block. The search 
engine 1930 is able to search for up to several (four in our embodiment) reference strings 
anywhere in a target, and, if one of the reference strings is found, returns which reference 
string and the position in the target of the reference string. 

The flow key address generator 1911 generates the address to where the state 
25 processor 1 108 is accessing in the unified flow key buffer. The main blocks of the 
SPFKAG are a flow key address pointer register, and a ROM decode that generates 
addresses. 

The flow-entry address generator 1913 provides the address where the state 
processor 1 108 is accessing the flow-entry in the cache subsystem 1 1 15. If a flow-entry 
30 exists, the upper address bits come from the hash is used to lookup the bucket in the flow 
database 324. The middle bits come from the bucket entry found. The lower bits come 
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from the offset the state processor 1108 is using. 

The main blocks of the SPFKAG are a flow key pointer register, and a ROM 
decode that generates addresses. 

The state processor UFKB Data Mux 1915 selects the data source destined to the 
5 UFKB. It multiplexes one of three sources of data into the UFKB. The three sources are 
an ALU output data bus, the cache output data bus and the SPCB data. The select signal is 
a 2-bit signal. 

The state processor Cache Data Mux 1917 selects the data source destined to the 
cache subsystem out of four sources of data into the cache subsystem. The four sources 
10 are: the ALU output data bus, the lower bits of the UFKB data bus, the upper bits of the 
UFKB data bus and the SPCB Data. The select signal is a 2-bit signal. In order to allow 
for 16bit moves, the SPMUXCA incorporates two 16bit Muxes that supply information to 
the lower and upper 16bits of the cache subsystem. 

The State Processor ALU Data Mux A 1919 selects the data source destined to the 
15 UFKB and multiplexes one of three sources of 32 bit data into the A side of the ALU. The 
three sources are the cache subsystem data bus, the lower 32 bits of the UFKB data bus 
and the upper 32 bits of the UFKB data bus. The select signal is a 2-bit signal. 

The state processor ALU Data Mux B 1919 selects the data source destined to the 
B side of the SP ALU and multiplexes one of two sources of 32 bit data into the B side of 
20 the ALU. The two sources are the cache subsystem data bus, and the SPCB data word. 
The select signal is a 1-bit signal. 

State Processor Instruction Definitions 

The following sections describe some of the instructions available in the state 
processor 1 108. It should be noted that typically, no assembler is provided for the state 
25 processor 1 108. This is because the engineer typically need not write code for this 

processor. The Compiler writes the code and loads it into the state processor instruction 
database from the protocols defined in the Protocol List (PDL files). 

The table is divided into two embodiments, embodiment 1, and embodiment 2 
which is a more complex embodiment that includes more complex versions of 
30 embodiment 1 instructions and additional instructions. 
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State Processor Instruction Definition 


EMBODIMENT 1 Instructions (a simpler embodiment) 


Instruction 


Description 


In_Noop 


No Operation 


InJWait 


Wait for a condition to occur, jump absolute based on the 
condition 


in_caii 


Call a subroutine 


in_Keturn 


Keturn rrom a suoroutine 


t_ \X7«5#TD 

in_waiUK 


Wait for a condition to occur, jump relative based on the 
condition 


In Jump 


Jump to an immediate jump vector based on a condition 


In_Move 


Move Data from Location X, to Location Y 


In_Load_FKAG 


Load the FK Address Generator I9l l 


In_Inc_FKAG 


Increment the FK Address Generator 19 1 1 


In__Dec_FKAG 


Decrement the FK Address Generator 1911 


In_Load_FEAG 


Load the FE Address Generator 1913 


In_Inc_FEAG 


Increment the FE Address Generator 1913 


In_DecJFEAG 


Decrement the FE Address Generator 1913 


In_Set_SPDone 


Set the SP Done Bit, a bot to indicate SP1 108 done 
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EMBODIMENT 1 ALU Instructions 


Instruction 


Description 


In INC 

All ^ 


Increment the value in the A Register 


In_DEC 


Decrement the value in the A Register 


In_ADD 


ADD Register A + Register B 


InSUB 


Subtract Register A - Register B 


In_AND 


Bitwise OR Register A, Register B 


In_OR 


Bitwise OR Register A, Register B 


In_XOR 


Bitwise XOR Register A , Register B 


In.COM 


Bitwise Complement Register A 


In_Simple_Compare 


Compare Reg A, with Reg B. Returns a SPALU.MATCH if 
equal 




EMBODIMENT 2 ALU Instructions (more complex implementation) 


Instruction 


Description 


In_Compare 


See if the string at a fixed location matches one in a reference 
string array of reference strings 


In_Find 


Find a string (or a set of strings) in a range, with the starting 
position unknown 


Xn_FindContinue 


Perform a Find operation starting from the location where the 
last string was found. 


In_AD2B 


Convert an ASCII Decimal character to Binary 


In_AD2BContinue 


Convert an ASCII Decimal character to Binary 


In_AH2B 


Convert an ASCII Hex character to Binary 


In_AH2BContinue 


Convert an ASCII Hex character to Binary 



Some of these instructions are now described in more detail. 
Move 

The move instruction set includes specific move instructions that deal with 
moving different size words from a source to a destination. The set of Move instructions 
has been developed to ensure the word sizes always match, and includes 32 bit and 16 bit 
Move instructions 

The Move instruction moves data from: immediate data to the SP ALU B register, 
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immediate data to the cache subsystem, immediate data to the UFKB, the SP ALU Output 
to the UFKB, the SP ALU Output to the cache subsystem, the cache to the UFKB, the 
cache to the SP ALU A register, the cache to the SP ALU B register, UFKB to the cache 
subsystem, and the UFKB to the SP ALU A register. 

5 In_Compare 

The In_Compare instruction instructs the ALU 1907 to perform a compare 
operation and return a MATCH signal along with the matched string information. A 
compare operation compares a target data whose first character is located at a known 
location in the UFKB, and a known reference string in the reference string memory. Prior 
10 to executing this instruction, the SP UFKB address generator 191 1 is loaded with the 

address pointing to the target character. A location in the ALU reference memory holds a 
list of reference characters to compare. 

ASCII Decimal to Binary 

This instruction passes the location of an ASCII code string representing a decimal 
15 value. The result is the binary equivalent value. This is carried out in one cycle. 

ASCII Hex to Binary 

This instruction passes the location of an ASCII code string representing a hex 
value. The result is the binary equivalent value. This is carried out in one cycle. 

In_Find 

20 InJFind_Continue 

These instructions are described in more detail in the following section describing the 
search engine 1930. 

The Search Engine and SP Instructions Invoking the Search Engine 

One aspect of the monitor 300 is its ability to analyze each and every packet in 
25 real time. Network traffic may move at a very fast rate. One of the tasks of the state 
processor 1 107 is to search for one or more known strings of data. Such searches are 
carried out on the UFKB records, for example, in the payload section of the record. The 
searches may be in known parts of the record, or may be in unknown parts of the record, 
for example, anywhere in the payload part of a UFKB record. Furthermore, the searches 
30 may need to be carried out at extremely high rates. 
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The state processor ALU includes a search engine SPALUJSE 1930 for carrying 
out such searches. The search engine 1930 is capable of searching up to four reference 
strings in a target area in the UFKB, and in parallel indicates (1) if any of the four strings 
are found anywhere in the target, (2) which string was found, and (3) where in the target 
5 the string was found. 

The search engine provides for carrying out the following state processor 
instructions. 

InJFind 

The m_Find instruction provides information to the ALU-Search Engine to 
10 perform a Find operation and return a match signal along with the matched string 
information and the location at which the string was found in the target. 



The instruction format is as follows: 

ln_Pind [Reference String Array Address], [UFKB Byte Offset], [Range] 



Instruction Word Definition 


Bit 


Description 


In_Find 


OpCode 


N (size of 
Abus) 


Reference String Array Address in the ALU Reference Memory. 

the ALU Reference Memory can store an array of one to four 
reference strings to be found. Each reference string is N R units long, 
in our implementation, a unit is a byte, and Nr is 16. 


Offset (2:0) 


UFKB Byte Offset 

This is the offset address pointing to a byte in the selected UFKB 
entry. 

The offset is used to determine which byte within the selected 
UFKB entry is the first byte location to start the find operation. If 
the UFKB is 64 bits (8 bytes) this field would be 3 bits wide and 
point to the first target byte to start the find operation. 


Range (7:0) 


The Range, in number of bytes, in the UFKB area to be searched. 

This means the number of bytes to search. It typically specifies how 
many bytes of a particular field in the particular UFKB record to 
search. \ 

If a full MATCH does not result after comparing this range, the find 
operation is concluded. 
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Reference String Memory Data Structure for in_Pind Operations 


Bit Field 


Description 


# of Strings 
(8 bits) 


# of Strings in Array indicates the total number of strings in this 
array. Valid numbers are 0,1,2,3 for 1,2,3 or 4 strings. 

8 bits are allocated for future expansion and to simplify the 
implementation. 


Size of 1 st 
String 

(4 bits) 


This parameter indicates the size of the 1 st string in bytes. The value 
placed here is N R j -1. Valid numbers are 0-F for a string as small as 
1 character and as large as OxF characters. 


Size of 2 nd 
String 


This parameter indicates the size of the 2 nd string in bytes. The value 
placed here is N R 2 ~1- Valid numbers are 0-F for a string as small as 
1 character and as large as OxF characters. 


Size of 3 rd 
String 

(4 bits) 


This parameter indicates the size of the 3 rd string in bytes. The value 
placed here in -1. Valid numbers are 0-F for a string as small as 
1 character and as large as OxF characters. 


Size of 4 th 
String 

(4 bits) 


This parameter indicates the size of the 4 th string in bytes. The value 
placed here in N R4 -1. Valid numbers are 0-F for a string as small as 
1 character and as large as OxF characters. 


Stringl 


1 to 16 (=N R ) characters of stringl. 


String2 


1 to 16 (=N R ) characters of string2. 


String3 


1 to 16 (=N R ) characters of string3. 


String4 


1 to 16 (=N R ) characters of string4. 


Vector 
(16 bits) 


This is a 16 bit (i.e., N R -bit) vector returned to the program counter 
to point to an area in the SPID that processes the result of the 
In_Find. 



When the search is complete, a Search Done bit is asserted. A MATCH bit is 
asserted or reset based on the result of the search. A bus in the ALU, called the 
5 ALU_DATA bus, will hold the following information: 

• Jump_Vector[15:0] - this is a vector stored in the Reference String Array 
and indicates what instructions (e.g., subroutine) the state processor jumps to 
when a reference string is found. 
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• String Code[ 1 :0] - this is the string code indicating which of the reference 
strings was found, i.e., 0, 1, 2, or 3 for the four reference string 
implementation. 

The location at which the string was found in the Flow Key Buffer is maintained. 
5 This is a combination of the UFKB word address and the byte location of the first 
character of the target found string. 

The search is done if the first occurrence of any of the reference strings is found, 
or if there is no MATCH in the entire search range. 

Consider the following example. Assume we wish to search for a reference string 
10 in the payload area of the UFKB and search starting at byte location 5 of the payload and 
stop searching at byte location 100. Assume the reference string is located at location 
0050h. The instruction format for this example would be as follows: 

In_tioad_FKAG f payload address 
In_Find, 0050 16 , 5, 60j 6 
15 The range would be 100 - 5 + 1 = 96 = 60 16 

Consider as a second example, searching locations 12 16 to location 2A 16 in the 
UFKB. The following state processor instructions will achieve this. 
In_Load_FKAG 02 16 

In_Pind [Reference String Address] ,2, 19 16 
20 Note that 2A 16 - 12 16 +1 = 19 16 . 

In_Find_Cont inue 

This instruction follows an ln_Find instruction and tells the ALU-Search Engine 
1930 to perform a Find operation starting from the location where the last string was 
found and return a MATCH along with the matched string information and the location at 
25 which the target string was found. The purpose for this instruction is to facilitate 

searching for a new reference string starting from the location where a previous search 
ended. Therefore, an offset is not provided since the Search Engine will remember the 
location where it finished its previous search. 
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The instruction format is as follows: 

in_Find_Continue [Reference String Array Address], [0], [Range] 



Instruction Word Definition 


Bit 


Description 


In_Find 


Opcode 


N (size of 


Reference String Array Address in the ALU Reference Memory. 

At this location, there is an array of one to four reference strings to 
be found. A Reference String Data Structure of the array is defined 
in the Reference Memory Data Structure section below. 

(Default N= 16) 


Offset (2:0) 


UFKB Byte Offset 

Always Zero. j 


Range (7:0) 


The Range, in number of byte, in the UFKB area to be searched. 
This means the number of bytes to search. 

If a full MATCH does not result after comparing this range, the find 
operation is concluded. 



10 



As an example, assume we wish to ln_Find a string (String A) in the payload 
area of the UFKB and search starting at byte location 5 of the payload and stop searching 
at byte location 100. Assume the reference string (String A) is located at location 0050 16 . 
After finding the first reference string, assume we wish to continue searching for a new 
string (String B) in the following 30 16 bytes. Assume String B is located at location 

0080h. 

The instruction format for this example would be as follows: 
In_Load_FKAG, payload address 
In_Find, 005016, 5, 6016 



15 



In_Find_Continue, 0080 16 , 5, 30 16 
The range would be 100 - 5 + 1 = 96 = 60 16 

FIG. 20 is an overall block diagram of the search engine (SPALU_SE) 1930 that 
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is part of the ALU 1907 and that executes the in.Find and in_Find_Contimie 
instructions issued to the ALU 1907. The in_Find Instructions searches an area of the 
TJFKB and looks for up to four possible reference strings in the target (UFKB) area. The 
reference strings are stored in the ALU Reference String Memory. 
5 As shown in Fig. 20, the Search Engine is coupled with the following 

components: 

(a) ALU String Reference Memory 2003 where the reference strings are 

stored. 

(b) SPALU Data Mux A 19 19 through which the target data 201 1 for 
10 matching with the reference string is supplied. This is coupled to the UFKB during 

operation of the in.Find instruction using SPJJFKB Data Mux 1915. 

(c) SPALU Data Mux B 1921 through which the instruction code is supplied, 
including the "Go" signal SPALUGO 2005 to start the search. 

(d) The state processor flow key address generator 191 1 used to increment and 
15 decrement the UFKB address. 

(e) The state processor program counter 1903 where the results of the search 
are reported. 

The system is run by a clock signal CLK 2001 and may be reset by a RESET 
signal. An instruction decode block SEJNST 2009 decodes the instruction code for 
20 m_Find and in_Find_Continue and starts the Search Engine upon the activation of 
the SPALUGO signal 2005. The Search Engine continuously monitors the SPMuxB 1921 
output bus 2007 and SPALUGO signal 2005 to detect the in.Find and 
ln_Find_Continue instructions. During operation of the search engine 1930 the engine 
receives the target data 201 1, in word size, from the UFKB 1 103 through SPMUXA 
25 1919. Similarly, the reference string(s) from the appropriate address of a reference string 
memory 2003 arrives as data SP_Data_RMB 2013. 

A Search Engine Reference Load (SE.LOAD) module 2015 is responsible for 
"priming" reference string registers once an ln_Fiad or in_Find_Continue 
instruction is issued. It takes a reference string array from the reference string memory 
30 2003 and interprets it and loads the reference string registers with the information. 
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In the processing state, the SE-LOAD module 2015 first loads the first word from 
the starting location of the reference memory 2003. The starting location is assumed to be 
set up at the proper location prior to issuing of the instruction. Once the number of strings 
and the size of the strings are loaded, the loading process continues loading all of the 

5 reference strings. An increment reference signal 2025 increments the reference memory 
from where the reference string is being loaded. During the loading of the strings, a 
LOAD_KEY_DONE signal 2017 is unasserted. A LOADJOEY signal 2019 is pulsed 
when the last word of the last reference string is being loaded indicating to the 
search_engine_module 2030 to start searching from the next clock cycle. The 

10 LOAD_KEY_DONE signal 2017 is asserted during the next clock cycle and the jump 
vector 2021 is loaded at the same time from the Reference Memory 2003. 

The Search Engine Increment/Control module (SEJNC) 2023 is responsible for 
incrementing the flow key address generator 191 1 in order to supply new words from the 
UFKB to the Search Engine. It monitors the found signals out of the Search Engine 
15 modules and reports results. SEJNC 2023 is also responsible for calculating true ending 
address and determines the last byte to be checked in the last word based on the Range 
provided in the in_Find instruction. 

The SE-4SEARCH 2030 module includes four search engines to search for four 
strings simultaneously. The engine outputs a found signal 2031 and a position signal 2033 
20 for each of the four reference strings to indicate if and where the string was found. 

The assertion of SPALU_Done signal 2035 by SE-INC 2023 indicates the search 
is completed. If the SPALU_Match signal 2037 is asserted at the same time then it is a 
successful search. The successful search also results in the SPALtLData bus 2039 
carrying the jump vector along with the search engine number that found the reference 
25 string. 

One aspect of the invention is the speediness of searching. The longest time for 
the SPALU_Done 2035 to be asserted from the time the instruction is issued for searching 
anywhere in a number N of words in the UFKB is N clock cycles plus an additional 
number of clock cycles for pre-loading and pointer adjustment in case of successful 
30 search. In our embodiment, this additional overhead is 1 1 clock cycles. Therefore, each 
extra word takes only one clock cycle. 
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FIG. 21 shows the SE_4SEARCH module 2030 that includes four single search 
modules. Alternate embodiments may include more single search modules to enable 
searching for more than four reference strings simultaneously. Each of the four search 
engine modules is identical, so only one such module 2103 will be described. 

5 Each of the single search modules 2 103 performs a single reference string search. 

Using multiple copies of this module multiple distinct reference strings can be searched in 
a common source buffer (the UFKB). The module includes a core comparator matrix 
block 2105 (the search engine core) and a state machine SE.SM 2107. The search engine 
core 2105 is capable of comparing a reference string up to N R units (1 6 bytes in our 

10 embodiment) with a target string of three eight-byte words (loaded in three successive 
cycles, one word at a time). During each clock cycle, the single search modules 2103 
searches for the reference string anywhere in the target starting from any of the eight 
bytes of the first word. Each of the reference string bytes is appended with a check bit, 
which indicates whether to check this byte, or not. If the check bit is asserted, then the 

15 corresponding byte checking is disabled. As 64-bit words (8 bytes) are loaded into three 
registers in a pipelined fashion, the comparison takes place two clock cycles after they are 
fetched. 

The source (UFKB) address pointer needs to be adjusted if the search is 
successful. If the search is successful, a match signal 2111 becomes active and the 

20 position of the first byte of the reference string is placed out on a position bus 21 13. The 
SE_SM state machine 2107 performs several tasks every clock cycle. It has three states: 
reset, idle, and process. While in the idle state, the state machine 2107 waits for a signal 
from the SE_LOAD module 2015 to switch to the Process State. During the first clock 
cycle in the Process State, if a match occurs then the position is checked against the byte 

25 offset 21 15. If the byte offset is greater then the position, then it is ignored, i.e. found is 
not asserted. Similarly, if it is the last word to be checked, then the end offset byte is 
checked with the position and the found is ignored if the position is greater then last byte 
to be checked in the range 21 17. Otherwise, the found signal is asserted when the match is 
found by the search engine core 2105 and the position is latched and forwarded to the 

30 SEJNC module 2023. 

Referring now to FIG. 22A, the search engine core 2105 is the core comparator 
matrix of the search engine module. It searches for an N R -unit reference string in a target 
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string. It includes a reference axis and a target axis. The reference axis includes a register 
that holds the reference string, in general a string of N R units. The unit is a byte and N R is 
16 in the preferred embodiment, and other units and the matrix may easily be modified to 
search for other reference string sizes. The target data is organized as words. The target 
5 axis is arranged as a series of one word registers each holding a word of target data. A 
word is clocked into the register in one clock cycle. Thus, the first word of the target data 
is clocked into the target axis in three cycles. 

The search engine core 2105 includes at least one N R -unit comparator each having 
N R pairs of inputs and an output indicating a match of each pair of the N R -pairs of inputs. 

10 One such comparator 2203 is shown in FIG. 22B. The pairs of inputs are shown as (2207- 
1, 2209-1), (2207-2, 2202-2), (2207-N R , 2207-N R ). The output is 2211. FIG. 22A 
shown a number (say N start ) comparators labeled 2203-1, 2203-2, .. ., 2203- N start . 
Considering any one of the comparators, the search engine core also includes a matrix of 
connections including N R connections indicating values of the reference string along the 

15 reference axis, and N R connections indicating values of the target data along the target 
axis, the target data connections starting from a first starting location of the target data 
and ending at an ending location. The comparators are connected such that when the 
reference and target axes are oriented perpendicular to each other, any comparator is 
oriented along the diagonal of the matrix such that N R connections of the target data are 

20 compared to the reference string. Each comparator starts at a different location in the 
target axis. In our implementation, each word is 8 bytes long, the number of comparators 
N start is the same as the word size, and the comparators start at contiguous locations on 
the target axis. Thus, in one clock cycle the search engine core 2105 can find the 
reference string starting from any location in the first word. Notice that if a target string 

25 happens to cross a word boundary, the search engine core will still automatically find the 
word. 

The outputs of the comparators are input into an N start input priority encoder that 
indicates if a string is found which of the N start comparators found the string. This 
provides for the location. 

30 During operation after the data is loaded, in the first clock cycle, the state machine 
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2107 will ignore any strings that might be found in the first few comparators, that number 
of comparators indicated by the offset. During each subsequent clock cycle, the search 
engine core 2105 will find the reference string if it starts anywhere in the first N start 
positions. Thus, in a number of clock cycles, the search engine core 2105 will find the 
5 reference string anywhere in the target data. 

FIG. 23A shows an implementation of the input core in more detail. This 
implementation is for finding the reference string in any of a set of starting positions. The 
implementation includes a reference register 2203 for receiving the N R units of one of the 
reference strings, a set of target data registers 2205 coupled in series to receive the target 

10 data, a plurality of comparator sets, one comparator set corresponding to each of the 
starting positions, the comparator set of a particular starting position coupled to each 
un it — each byte in this implementation — of the reference register and to N R units — bytes 
in this case — of the target data registers starting from the particular starting position and 
comparing the first reference register contents to N R units of the target data registers 

15 starting from the particular staring position. Each comparator set indicates if there is a 
match of first reference string in the target data starting from its corresponding different 
starting position. The set of possible starting positions might include N start different 
positions. These positions may or may not be contiguous, and if contiguous, the one or 
more target data registers are coupled in series to receive at least N R +N start -1 units of the 

20 target data. Thus there are N start comparator sets, one comparator set for each of the N start 
starting positions. 

Each comparator set includes N R consecutive comparators. One such comparator 
2313 is shown in FIG. 23B, and includes a reference input, a target input, an enable input, 
and an output indicating a match, such that the output of a comparator 2313 is asserted 

25 when the reference and target inputs match and the enable input is asserted. For a 
particular set of comparators for a particular starting position, the reference inputs of 
consecutive comparators are coupled to consecutive units of the reference register, the 
target data inputs of consecutive comparators are coupled to consecutive units of the 
target data registers starting at the particular starting location, the first comparator of the 

30 set is enabled, and the enable input of each comparator is coupled to the output of the 
previous comparator, such that the output of the final comparator is asserted when the N R 
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units of the reference string and the N R units of the target data agree. 

In this way, the state processor is able to locate strings at unknown locations in 
areas of the packets (stored in the UFKB) at an extremely high rate. 

The Cache Subsystem 

5 Referring again to FIG. 1 1, the cache subsystem 1 1 15 is connected to the lookup 

update engine (LUE) 1 107, the state processor the state processor (SP) 1 108 and the flow 
insertion/deletion engine (FIDE) 1110. The cache 1115 keeps a set of flow-entries of the 
flow-entry database stored in memory 1 123, so is coupled to memory 1 123 via the unified 
memory controller 1119. According to one aspect of the invention, these entries in the 

10 cache are those likely-to-be-accessed next. 

It is desirable to maximize the hit rate in a cache system. Typical prior-art cache 
systems are used to expedite memory accesses to and from microprocessor systems. 
Various mechanisms are available in such prior art systems to predict the lookup such that 
the hit rate can be maximized. Prior art caches, for example, can use a lookahead 

15 mechanism to predict both instruction cache lookups and data cache lookups. Such 
lookahead mechanisms are not available for the packet monitoring application of cache 
subsystem 1115. When a new packet enters the monitor 300, the next cache access, for 
example from the LUE 1 107, may be for a totally different flow than the last cache 
lookup, and there is no way ahead of time of knowing what flow the next packet will 

20 belong to. 

One aspect of the present invention is a cache system that replaces a least recently 
used (LRU) flow-entry when a cache replacement is needed. Replacing least recently used 
flow-entries is preferred because it is likely that a packet following a recent packet will 
belong to the same flow. Thus, the signature of a new packet will likely match a recently 
25 used flow record. Conversely, it is not highly likely that a packet associated with the least 
recently used flow-entry will soon arrive. 

Furthermore, after one of the engines that operate on flow-entries, for example the 
LUE 1 107, completes an operation on a flow-entry, it is likely that the same or another 
engine will soon use the same flow-entry. Thus it is desirable to make sure that recently 
30 used entries remain in the cache. 
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A feature of the cache system of the present invention is that most recently used 
(MRU) flow-entries are kept in cache whenever possible. Since typically packets of the 
same flow arrive in bursts, and since MRU flow-entries are likely to be required by 
another engine in the analysis subsystem, maximizing likelihood of MRU flow-entries 

5 remaining in cache increases the likelihood of finding flow records in the cache, thus 
increasing the cache hit rate. 

Yet another aspect of the present cache invention is that it includes an associative 
memory using a set of content addressable memory cells (CAMs). The CAM contains an 
address that in our implementation is the hash value associated with the corresponding 

10 flow-entry in a cache memory (e.g., a data RAM) comprising memory cells. In one 
embodiment, each memory cell is a page. Each CAM also includes a pointer to a cache 
memory page. Thus, the CAM contents include the address and the pointer to cache 
memory. As is conventional, each CAM cell includes a matching circuit having an input. 
The hash is presented to the CAM's matching circuit input, and if the hash matches the 

15 hash in the CAM, the a match output is asserted indicating there is a hit. The CAM 
pointer points to the page number (i.e., the address) in the cache memory of the flow- 
entry. 

Each CAM also includes a cache address input, a cache pointer input, and a cache 
contents output for inputting and outputting the address part and pointer part of the CAM. 

20 The particular embodiment cache memory stores flow-entries in pages of one 

bucket, i.e., that can store a single flow-entry. Thus, the pointer is the page number in the 
cache memory. In one version, each hash value corresponds to a bin of N flow-entries 
(e.g., 4 buckets in the preferred embodiment of this version). In another implementation, 
each hash value points to a single flow record, i.e., the bin and bucket sizes correspond. 

25 For simplicity, this second implementation is assumed when describing the cache 1 1 15. 

Furthermore, as is conventional, the match output signal is provided to a 
corresponding location in the cache memory so that a read or write operation may take 
place with the location in the cache memory pointed to be the CAM. 

One aspect of the present invention achieves a combination of associatively and 
30 true LRU replacement policy. For this, the CAMs of cache system 1 1 15 are organized in 
what we call a CAM stack (also CAM array) in an ordering, with a top CAM and a 
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bottom CAM. The address and pointer output of each CAM starting from the top CAM is 
connected to the address and pointer input of the next cache up to the bottom. 

In our implementation, a hash is used to address the cache. The hash is input to the 
CAM array, and any CAM that has an address that matches the input hash asserts its 
5 match output indicating a hit. When there is a cache hit, the contents of the CAM that 
produced the hit (including the address and pointer to cache memory) are put in the top 
CAM of the stack. The CAM contents (cache address, and cache memory pointer) of the 
CAMs above the CAM that produced are shifted down to fill the gap. 

If there is a miss, any new flow record is put in the cache memory element pointed 
10 to by the bottom CAM. All CAM contents above the bottom are shifted down one, and 
then the new hash value and the pointer to cache memory of the new flow-entry are put in 
the top-most CAM of the CAM stack. 

In this manner, the CAMs are ordered according to recentness of use, with the 
least recently used cache contents pointed to by the bottom CAM and the most recently 
15 used cache contents pointed to by the top CAM. 

Furthermore, unlike a conventional CAM-based cache, there is no fixed 
relationship between the address in the CAM and what element of cache memory it points 
to. CAM's relationship to a page of cache memory changes over time. For example, at 
one instant, the fifth CAM in the stack can include a pointer to one particular page of 
20 cache memory, and some time later, that same fifth CAM can point to a different cache 
memory page. 

In one embodiment, the CAM array includes 32 CAMs and the cache memory 
includes 32 memory cells (e.g., memory pages), one page pointed to by each CAM 
contents. Suppose the CAMs are numbered CAMq, CAM^ CAM 31 , respectively, 
25 with CAMq the top CAM in the array and CAM 31 the bottom CAM. 

The CAM array is controlled by a CAM controller implemented as a state 
machine, and the cache memory is controlled by a cache memory controller which also is 
implemented as a state machine. The need for such controllers and how to implement 
them as state machines or otherwise would be clear to one skilled in the art from this 
30 description of operation. In order not to confuse these controllers with other controllers, 
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for example, with the unified memory controller, the two controllers will be called the 
CAM state machine and the memory state machine, respectively. 

Consider as an example, that the state of the cache is that it is full. Suppose 
furthermore that the contents of the CAM stack (the address and the pointer to the cache 
memory) and of the cache memory at each page number address of cache memory are as 
shown in the following table. 



15 



CAM 


Hash 


Cache Point 




Cache Addr. 


Contents 


CAMo 


hasho 


page 0 




page 0 


entry 0 


CAMJ 


hash] 


pagei 




pagei 


entry 1 


CAM 2 


hash 2 


pag^ 




pag^ 


entry 2 


CAM 3 


hash 3 


page 3 




page 3 


entry 3 


CAM 4 


hash4 


page 4 




page 4 


entry 4 


CAM 5 


hash 5 


page 5 




page 5 


entry 5 


CAM 6 


hash 6 


page 6 




page6 


entry 6 


CAM 7 


hash7 


page 7 




page? 


entry 7 














CAM 29 


hash 2 9 


pagejg 




page 29 


entry 29 


CAM 30 


hash 30 


page 30 




page 3 o 


entry 30 


CAM 31 


hash 31 


page 3 i 




page 3J 


entry 31 



This says that CAM 4 contains and will match with the hash value hast^, and a lookup 
with hash 4 will produce a match and the address page 4 in cache memory. Furthermore, 
page 4 in cache memory contains the flow-entry, entry 4 , that in this notation is the flow- 
entry matching hash value hasl^. This table also indicates that hasho was more recently 
used than hashi, hash 5 more recently than hash 2 , and so forth, with hash 31 the least 
recently used hash value. Suppose further that the LUE 1 107 obtains an entry from 
unified flow key buffer 1 103 with a hash value hash 3 , . The LUE looks up the cache 
subsystem via the CAM array. CAM 31 gets a hit and returns the page number of the hit, 
i.e., page 31 . The cache subsystem now indicates to the LUE 1007 that the supplied hash 
value produced a hit and provides a pointer to page 31 of the cache memory which 
contains the flow-entry corresponding to hash 31 , i.e., flow 31 . The LUE now retrieve the 
flow-entry flow 31 from the cache memory at address page 31 . In the preferred 
embodiment, the lookup of the cache takes only one clock cycle. 
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The value hash 3 j is the most recently used hash value. Therefore, in accordance 
with an aspect of the inventive cache system, the most recently used entry is put on top of 
the CAM stack. Thus hash 31 is put into CAMq (pointing to page 31 ). Furthermore, hash 30 
is now the LRU hash value, so is moved to CAM 31 . The next least recently used hash 

5 value, hash 2 9 is now moved to CAM 30 , and so forth. Thus, all CAM contents are shifted 
one down after the MSU entry is put in the top CAM. In the preferred embodiment the 
shifting down on CAM entries takes one clock cycle. Thus, the lookup and the 
rearranging of the CAM array to maintain the ordering according to usage recentness. The 
following table shows the new contents of the CAM array and the (unchanged) contents 

10 of the cache memory. 



CAM 


Hash 


Cache Point 




Cache Addr. 


Contents 


CAMq 


hash 31 


Page 3 i 




pageo 


entiyo 


CAMj 


hasho 


page 0 




pagei 


entry j 


CAM 2 


hash] 


pagei 




page2 


entry 2 


CAM 3 


hash2 


page 2 




page 3 


entry 3 


CAM 4 


hash 3 


page 3 




page 4 


entry 4 


CAM 5 


hash 4 


page 4 




page 5 


entry 5 


CAM 6 


hash 5 


page 5 




page 6 


entry 6 


CAM 7 


hash 6 


page 6 




pagey 


entry 7 














CAM 29 


hash 2 g 


page28 




page^g 


entry 2 9 


CAM 30 




page29 




page 30 


entry 30 


CAM 31 


hash3Q 


page 30 




page 31 


entry 3 j 



To continue with the example, suppose that some time later, the LUE 1007 looks 
up hash value hash 5 . This produces a hit in CAMg pointing to page5 of the cache 

memory. Thus, in one clock cycle, the cache subsystem 1115 provides LUE 1007 with an 
indication of a hit and the pointer to the flow-entry in the cache memory. The most recent 
15 entry is hash 5 , so hash 5 and cache memory address page6 are entered into CAMq. The 

contents of the remaining CAMs are all shifted down one up to and including the entry 
that contained hash 5 . That is, CAM 7 , CAMg, CAM 31 remain unchanged. The CAM 

array contents and unchanged cache memory contents are now as shown in the following 
table. 
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CAM 


Hash 


Cache Point 




Cache Addr. 


Contents 


CAMrx 


hash^ 


page* 




pageo 


entry 0 


fAM, 

V-/JrVlVl 1 


hasho 1 


r o j 1 




page! 


entry 1 


CAM 2 


hash 0 


pageo 




page 2 


entry 2 


CAM 3 


hash] 


pagei 




page 3 


entry 3 


CAM 4 


hash 2 


page 2 




page 4 


entry 4 


CAM 5 


hash 3 


page 3 




page 5 


entry 5 


CAMe 


hash 4 


page 4 




page 6 


entry 6 


CAM 7 


hash 6 


page 6 




page7 


cnixy'7 














CAM 29 


hash 2 g 


page 2 8 




page 29 


entry 2 9 


CAM 30 


hash29 


page 2 9 




pag©30 


entry 30 


CAM 31 


hash3Q 


page3o 




page 31 


entry 31 



Thus in the case of cache hits, the CAM array always keeps used hash values in 
the order of recentness of use, with the most recently used hash value in the top CAM. 



The operation of the cache subsystem when there is a cache hit will be described 
by continuing the example. Suppose there is a lookup (e.g., from LUE 1 107) for hash 

5 value hash 43 . The CAM array produces a miss that causes in a lookup using the hash in 
the external memory. The specific operation of our specific implementation is that the 
CAM state machine sends a GET message to the memory state machine that results in a 
memory lookup using the hash via the unified memory controller (UMC) 1 1 19. However, 
other means of achieving a memory lookup when there is a miss in the CAM array would 

10 be clear to those in the art. 

The lookup in the flow-entry database 324 (i.e., external memory) results in a hit 
or a miss. Suppose that the database 324 of flow-entries does not have an entry matching 
hash value hash 43 . The memory state machine indicates the miss to the CAM state 
machine which then indicates the miss to the LUE 1007. Suppose, on the other hand that 

15 there is a flow-entry— entry 43 — in database 324 matching hash value hash4 3 . In this case, 
the flow-entry is brought in to be loaded into the cache. 

In accordance with another aspect of the invention, the bottom CAM entry 
CAM 31 always points to the LRU address in the cache memory. Thus, implementing a 
true LRU replacement policy includes flushing out the LRU cache memory entry and 
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inserting a new entry into that LRU cache memory location pointed to by the bottom 
CAM. The CAM entry also is modified to reflect the new hash value of the entry in the 
pointed to cache memory element. Thus, hash value hash 43 is put in CAM 31 and flow- 
entry entry 43 is placed in the cache page pointed to by CAM 3 1 . The CAM array and now 
5 changed cache memory contents are now 



CAM 


Hasn 


Uacne Jroint 






^onienis 


CAMq 


hash 5 


page 5 




page 0 


entry 0 


CAMj 


hash3i 


page 3 i 




page] 


entryj 


CAM 2 


hasho 


page 0 




page 2 


entry 2 


CAM 3 


hashj 


page, 




page 3 


entry 3 


CAM 4 


hash 2 


pagej 




page 4 


entry 4 


CAM 5 


hash 3 


page 3 




page 5 


entry 5 


CAM 6 


hash 4 


page 4 




Page 6 


entry 6 


CAM 7 


hashg 


page 6 




Page 7 


entry 7 




• • . 


• • • 








CAM 29 


hash2g 


page28 




page29 


entry 2 9 


CAM 30 


hash 2 9 


Page29 




page 3 o 


entry 43 


CAM 31 


hash43 


page 30 




page 3 j 


entry 3 ] 



Note that the inserted entry is now the MRU flow-entry. So, the contents of 
CAM 31 are now moved to CAMo and the entries previously in the top 30 CAMs moved 
down so that once again, the bottom CAM points to the LRU cache memory page. 
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Note that the inserted entry is now the MRU flow-entry. So, the contents of 
CAM 31 are now moved to CAM 0 and the entries previously in the top 30 CAMs moved 

In addition to looking up entries of database 324 via the cache subsystem 1 1 15 for 
retrieval of an existing flow-entry, the LUE, SP, or FIDE engines also may update the 

5 flow-entries via the cache. As such, there may be entries in the cache that are updated 
flow-entries. Until such updated entries have been written into the flow-entry database 
324 in external memory, the flow-entries are called "dirty." As is common in cache 
systems, a mechanism is provided to indicate dirty entries in the cache. A dirty entry 
cannot, for example, be flushed out until the corresponding entry in the database 324 has 

10 been updated. 

Suppose in the last example, that the entry in the cache was modified by the 
operation. That is, hash 43 is in MRU CAM 0 , CAM 0 correctly points to page 30 , but the 
information in page 30 of the cache, entry 43 , does not correspond to entry 43 in database 
324. That is, the contents of cache page page 30 is dirty. There is now a need to update the 

15 database 324. This is called backing up or cleaning the dirty entry. 

As is common in cache systems, there is an indication provided that a cache 
memory entry is dirty using a dirty flag. In the preferred embodiment, there is a dirty flag 
for each word in cache memory. 
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Another aspect of the inventive cache system is cleaning cache memory contents 
according to the entry most likely to be first flushed out of the cache memory. In our LRU 
cache embodiment, the cleaning of the cache memory entries proceeds in the inverse 
order of recentness of use. Thus, LRU pages are cleaned first consistent with the least 
5 likelihood that these are the entries likely to be flushed first. 

In our embodiment, the memory state machine, whenever it is idle, is programmed 
to scan the CAM array in reverse order of recentness, i.e., starting from the bottom of the 
CAM array, and look for dirty flags. Whenever a dirty flag is found, the cache memory 
contents are backed up to the database 324 in external memory. 

10 Note that once a page of cache memory is cleaned, it is kept in the cache in case it 

is still needed. The page is only flushed when more cache memory pages are needed. The 
corresponding CAM also is not changed until a new cache memory page is needed. In this 
way, efficient lookups of all cache memory contents, including clean entries are still 
possible. Furthermore, whenever a cache memory entry is flushed, a check is first made to 

15 ensure the entry is clean. If the entry is dirty, it is backed up prior to flushing the entry. 

The cache subsystem 1 1 15 can service two read transfers at one time. If there are 
more than two read requests active at one time the Cache services them in a particular 
order as follows: 

(1) LRU dirty write back. The cache writes back the least recently used cache 

20 memory entry if it is dirty so that there will always be a space for the fetching 

of cache misses. 

(2) Lookup and update engine 1 107. 

(3) State processor 1 108. 

(4) Flow insertion and deletion engine 1110. 

25 (5) Analyzer host interface and control 1118. 

(6) Dirty write back from LRU -1 to MRU; when there is nothing else pending, 
the cache engine writes dirty entries back to external memory. 

FIG. 26 shows the cache memory component 2600 of the cache subsystem 1 1 15. 
Cache memory subsystem 2600 includes a bank 2603 of dual ported memories for the 
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pages of cache memory. In our preferred embodiment there are 32 pages. Each page of 
memory is dual ported. That is, it includes two sets of input ports each having address and 
data inputs, and two sets of output ports, one set of input and output ports are coupled to 
the unified memory controller (UMC) 1 1 19 for writing to and reading from the cache 
5 memory from and into the external memory used for the flow-entry database 324. Which 
of the output lines 2609 is coupled to UMC 1 1 19 is selected by a multiplexor 261 1 using 
a cache page select signal 2613 from CAM memory subsystem part of cache systeml 115. 
Updating cache memory from the database 324 uses a cache data signal 2617 from the 
UMC and a cache address signal 2615. 

10 Looking up and updating data from and to the cache memory from the 

lookup/update engine (LUE) 1 107, state processor (SP) 1 108 or flow insertion/deletion 
engine (FIDE) 1110 uses the other input and output ports of the cache memory pages 
2603. A bank of input selection multiplexors 2605 and a set of output selector 
multiplexors 2607 respectively select the input and output engine using a set of selection 

15 signals 2619. 

PIG. 27 shows the cache CAM state machine 2701 coupled to the CAM array 
2705 and to the memory state machine 2703, together with some of the signals that pass 
between these elements. The signal names are self-explanatory, and how to implement 
these controllers as state machines or otherwise would be clear from the description 
20 hereinabove. 

While the above description of operation of the CAM array is sufficient for one 
skilled in the art to design such a CAM array, and many such designs are possible, FIG. 
28 shows one such design. Referring to that figure, the CAM array 2705 comprises one 
CAM, e.g., CAM[7] (2807), per page of CAM memory. The lookup port or update port 

25 depend which of the LUE, SP or FIDE are accessing the cache subsystem. The input data 
for a lookup is typically the hash, and shown as REF-DATA 2803. Loading, updating or 
evicting the cache is achieved using the signal 2805 that both selects the CAM input data 
using a select multiplexor 2809, such data being the hit page or the LRU page (the bottom 
CAM in according to an aspect of the invention). Any loading is done via a 5 to 32 

30 decoder 281 1. The results of the CAM lookup for all the CAMs in the array is provided to 
a 32-5 low to high 32 to 5 encoder 2813 that outputs the hit 2815, and which CAM 
number 2817 produced the hit. The CAM hit page 2819 is an output of a MUX 2821 that 
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has the CAM data of each CAM as input and an output selected by the signal 28 17 of the 
CAM that produced the hit. Maintenance of dirty entries is carried out similarly from the 
update port that coupled to the CAM state machine 2701. A MUX 2823 has all CAMs' 
data input and a scan input 2827. The MUX 2823 produces the dirty data 2825. 

5 The Pattern Parse and Extraction Database Format 

The different protocols that can exist in different layers may be thought of as 
nodes of one or more trees of linked nodes. The packet type is the root of a tree (called 
base level). Each protocol is either a parent node of some other protocol at the next later 
or a terminal node. A parent node links a protocol to other protocols (child protocols) that 
10 can be at higher layer levels. Thus a protocol may have zero or more children. 

As an example of the tree structure, consider an Ethernet packet. One of the 
children nodes may be the IP protocol, and one of the children of the IP protocol may be 
the TCP protocol. Another child of the IP may be the UDP protocol. 

A packet includes at least one header for each protocol used. The child protocol of 
15 a particular protocol used in a packet is indicated by the contents at a location within the 
header of the particular protocol. The contents of the packet that specify the child are in 
the form of a child recognition pattern. 

A network analyzer preferably can analyze many different protocols. At a base 
level, there are a number of packet types used in digital telecommunications, including 

20 Ethernet, HDLC, ISDN, Lap B, ATM, X.25, Frame Relay, Digital Data Service, FDDI 
(Fiber Distributed Data Interface), and Tl, among others. Many of these packet types use 
different packet and/or frame formats. For example, data is transmitted in ATM and 
frame-relay systems in the form of fixed length packets (called "cells") that are 53 octets 
(i.e., bytes) long; several such cells may be needed to make up the information that might 

25 be included in a single packet of some other type. 

Note that the term packet herein is intended to encompass packets, datagrams, 
frames and cells. In general, a packet format or frame format refers to how data is 
encapsulated with various fields and headers for transmission across a network. For 
example, a data packet typically includes an address destination field, a length field, an 
30 error correcting code (ECC) field or cyclic redundancy check (CRC) field, as well as 
headers and footers to identify the beginning and end of the packet. The terms "packet 
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format," "frame format" and "cell format" are generally synonymous. 

The packet monitor 300 can analyze different protocols, and thus can perform 
different protocol specific operations on a packet wherein the protocol headers of any 
protocol are located at different locations depending on the parent protocol or protocols 

5 used in the packet. Thus, the packet monitor adapts to different protocols according to the 
contents of the packet. The locations and the information extracted from any packet are 
adaptively determined for the particular type of packet. For example, there is no fixed 
definition of what to look for or where to look in order to form the flow signature. In 
some prior art systems, such as that described in United States Patent 5,101,402 to Chiu, 

10 ex al, there are fixed locations specified for particular types of packets. With the 

proliferation of protocols, the specifying of all the possible places to look to determine the 
session becomes more and more difficult. Likewise, adding a new protocol or application 
is difficult. In the present invention, the number of levels is variable for any protocol and 
is whatever number is sufficient to uniquely identify as high up the level system as we 

15 wish to go, all the way to the application level (in the OSI model). 

Even the same protocol may have different variants. Ethernet packets for example, 
have several known variants, each having a basic format that remains substantially the 
same. An Ethernet packet (the root node) may be an Ethertype packet— also called an 
Ethernet Type/Version 2 and a DIX (DIGITAL-Intel-Xerox packet)— or an IEEE 
20 Ethernet (IEEE 803.x) packet. A monitor should be able to handle all types of Ethernet 
protocols. With the Ethertype protocol, the contents that indicate the child protocol is in 
one location, while with an IEEE type, the child protocol is specified in a different 
. location. The child protocol is indicated by a child recognition pattern. 

FIG. 16 shows the header 1600 (base level 1) of a complete Ethernet frame (i.e., 
25 packet) of information and includes information on the destination media access control 
address (Dst MAC 1602) and the source media access control address (Src MAC 1604). 
Also shown in FIG. 16 is some (but not all) of the information specified in the PDL files 
for extraction the signature. Such information is also to be specified in the parsing 
structures and extraction operations database 308. This includes all of the header 
30 information at this level in the form of 6 bytes of Dst MAC information 1606 and 6 bytes 
of Src MAC information 1610. Also specified are the source and destination address 
components, respectively, of the hash. These are shown as 2 byte Dst Hash 1608 from the 
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Dst MAC address and the 2 byte Src Hash 1612 from the Src MAC address. Finally, 
information is included (1614) on where to the header starts for information related to the 
next layer level. In this case the next layer level (level 2) information starts at packet 
offset 12. 

5 FIG. 17A now shows the header information for the next level (level-2) for an 

Ethertype packet 1700. 

For an Ethertype packet 1700, the relevant information from the packet that 
indicates the next layer level is a two-byte type field 1702 containing the child recognition 
pattern for the next level. The remaining information 1704 is shown hatched because it 
10 not relevant for this level. The list 1712 shows the possible children for an Ethertype 
packet as indicated by what child recognition pattern is found offset 12. 

Also shown is some of the extracted part used for the parser record and to locate 
the next header information. The signature part of the parser record includes extracted 
part 1702. Also included is the 1-byte Hash component 1710 from this information. 

15 An offset field 1710 provides the offset to go to the next level information, i.e., to 

locate the start of the next layer level header. For the Ethertype packet, the start of the 
next layer header 14 bytes from the start of the frame. 

Other packet types are arranged differendy. For example, in an ATM system, each 
ATM packet comprises a five-octet "header" segment followed by a forty-eight octet 

20 "payload" segment. The header segment of an ATM cell contains information relating to 
the routing of the data contained in the payload segment. The header segment also 
contains traffic control information. Eight or twelve bits of the header segment contain the 
Virtual Path Identifier (VPI), and sixteen bits of the header segment contain the Virtual 
Channel Identifier (VCI). Each ATM exchange translates the abstract routing information 

25 represented by the VPI and VCI bits into the addresses of physical or logical network 
links and routes each ATM cell appropriately. 

FIG. 17B shows the structure of the header of one of the possible next levels, that 
of the IP protocol. The possible children of the IP protocol are shown in table 1752. The 
header starts at a different location (L3) depending on the parent protocol. Also included 
30 in FIG. 17B are some of the fields to be extracted for the signature, and an indication of 
where the next level's header would start in the packet. 
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Note that the information shown in FIGS. 16, 17A, and 17B would be specified to 
the monitor in the form of PDL files and compiled into the database 308 of pattern 
structures and extraction operations. 

The parsing subsystem 301 performs operations on the packet header data based 
5 on information stored in the database 308. Because data related to protocols can be 
considered as organized in the form of a tree, it is required in the parsing subsystem to 
search through data that is originally organized in the form of a tree. Since real time 
operation is preferable, it is required to carry out such searches rapidly. 

Data structures are known for efficiently storing information organized as trees. 
10 Such storage-efficient means typically require arithmetic computations to determine 
pointers to the data nodes. Searching using such storage-efficient data structures may 
therefore be too time consuming for the present application. It is therefore desirable to 
store the protocol data in some form that enables rapid searches. 

In accordance with another aspect of the invention, the database 308 is stored in a 
15 memory and includes a data structure used to store the protocol specific operations that 
are to be performed on a packet. In particular, a compressed representation is used to store 
information in the pattern parse and extraction database 308 used by the pattern 
recognition process 304 and the extraction process 306 in the parser subsystem 301. The 
data structure is organized for rapidly locating the child protocol related information by 
20 using a set of one or more indices to index the contents of the data structure. A data 
structure entry includes an indication of validity. Locating and identifying the child 
protocol includes indexing the data structure until a valid entry is found. Using the data 
structure to store the protocol information used by the pattern recognition engine (PRE) 
1006 enables the parser subsystem 301 to perform rapid searches. 

25 In one embodiment, the data structure is in the form of a three-dimensional 

structure. Note that this three dimensional structure in turn is typically stored in memory 
as a set of two-dimensional structures whereby one of the three dimensions of the 3-D 
structure is used as an index to a particular 2-D array. This forms a first index to the data 
structure. 

30 FIG 18A shows such a 3-D representation 1800 (which may be considered as an 

indexed set of 2-D representations). The three dimensions of this data structure are: 
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1 . Type identifier [1 :M]. This is the identifier that identifies a type of 
protocol at a particular level. For example, 01 indicates an Ethernet frame. 64 
indicates P, 16 indicates an IEEE type Ethernet packet, etc. Depending on 
how many protocols the packet parser can handle, M may be a large number; 

5 M may grow over time as the capability of analyzing more protocols is added 

to monitor 300. When the 3-D structure is considered a set of 2-D structures, 
the type ID is an index to a particular 2-D structure. 

2. Size [1 :64]. The size of the field of interest within the packet. 

3. Location [1:512]. This is the offset location within the packet, expressed as 
10 a number of octets (bytes). 

At any one of these locations there may or may not be valid data. Typically, there 
will not be valid data in most locations. The size of the 3-D array is M by 64 by 512, 
which can be large; M for example may be 10,000. This is a sparse 3-D matrix with most 
entries empty (i.e., invalid). 

15 Each array entry includes a "node code" that indicates the nature of the contents. 

This node code has one of four values: (I) a "protocol" node code indicating to the pattern 
recognition process 304 that a known protocol has been recognized as the next (i.e., child) 
protocol; (2) a "terminal" node code indicating that there are no children for the protocol 
presently being searched, i.e., the node is a final node in the protocol tree; (3) a "null" 

20 (also called "flush") node code indicating that there is no valid entry. 

In the preferred embodiment, the possible children and other information are 
loaded into the data structure by an initialization that includes compilation process 310 
based on the PDL files 336 and the layering selections 338. The following information is 
included for any entry in the data structure that represents a protocol. 

25 (a) A list of children (as type IDs) to search next. For example, for an Ethernet 

type 2, the children are Ethertype ( IP, IPX, etc, as shown in 1712 of FIG. 
17). These children are compiled into the type codes. The code for IP is 64, 
that for IPX is 83, etc. 

(b) For each of the IDs in the list, a list of the child recognition patterns that 
30 need to be compared. For example, 64:0800 16 in the list indicates that the 
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value to look for is 0800 (hex) for the child to be type ID 64 (which is the IP 
protocol). 83:8137 16 in the list indicates that the value to look for is 8137 
(hex) for the child to be type ID 83 (which is the IPX protocol), etc. 

(c) The extraction operations to perform to build the identifying signature for 
5 the flow. The format used is (offset, length, flow_signature_value_identifier), 

the flow_signature_value_identifier indicating where the extracted entry goes 
in the signature, including what operations (AND, ORs, etc.) may need to be 
carried out. If there is also a hash key component, for instance, then 
information on that is included. For example, for an Ethertype packet, the 2- 
10 byte type (1706 in FIG 17) is used in the signature. Furthermore, a 1-byte 

hash (1708 in FIG. 17A) of the type is included. . Note furthermore, the child 
protocol starts at offset 14. 

An additional item may be the "fold." Folding is used to reduce the storage 
requirements for the 3-D structure. Since each 2-D array for each protocol ID may be 
15 sparsely populated, multiple arrays may be combined into a single 2-D array as long as 
the individual entries do not conflict with each other. A fold number is then used to 
associate each element. For a given lookup, the fold number of the lookup must match the 
fold number entry. Folding is described in more detail below. 

In the case of the Ethernet, the next protocol field may indicate a length, which 
20 tells the parser that this is a IEEE type packet, and that the next protocol is elsewhere. 
Normally, the next protocol field contains a value which identifies the next, i.e., child 
protocol. 

The entry point for the parser subsystem is called the virtual base layer and 
contains the possible first children, i.e., the packet types. An example set of protocols 
25 written in a high level protocol description language (PDL) is included herein. The set 
includes PDL files, and the file describing all the possible entry points (i.e., the virtual 
base) is called virtual.pdl. There is only one child, 01, indicating the Ethernet, in this file. 
Thus, the particular example can only handle Ethernet packets. In practice, there can be 
multiple entry points. 

30 In one embodiment, the packet acquisition device provides a header for every 
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packet acquired and input into monitor 300 indicating the type of packet. This header is 
used to determine the virtual base layer entry point to the parser subsystem. Thus, even at 
the base layer, the parser subsystem can identify the type of packet. 

Initially, the search starts at the child of the virtual base, as obtained in the header 
5 supplied by the acquisition device. In the case of the example, this has ID value 01, which 
is the 2-D array in the overall 3-D structure for Ethernet packets. 

Thus hardware implementing pattern analysis process 304 (e.g., pattern 
recognition engine (PRE) 1006 of FIG. 10) searches to determine the children (if any) for 
the 2-D array that has protocol ID 01. In the preferred embodiment that uses the 3-D data 
10 structure, the hardware PRE 1006 searches up to four lengths (i.e., sizes) simultaneously. 
Thus, the process 304 searches in groups of four lengths. Starting at protocol ID 01, the 
first two sets of 3-D locations searched are 

(1,1,1) (1,1,2) 
(1,2,1) (1,2,2) 
15 (1,3,1) (1,3,2) 

(1,4,1) (1,4,2) 

At each stage of a search, the analysis process 304 examines the packet and the 3- 
D data structure to see if there is a match (by looking at the node code). If no valid data is 
found, e.g., using the node code, the size is incremented (to maximum of 4) and the offset 
20 is then incremented as well. 

Continuing with the example, suppose the pattern analysis process 304 finds 
something at 1, 2, 12. By this, we mean that the process 304 has found that for protocol 
ID value 01 (Ethernet) at packet offset 12, there is information in the packet having a 
length of 2 bytes (octets) that may relate to the next (child) protocol. The information, for 
25 example, may be about a child for this protocol expressed as a child recognition pattern. 
The list of possible child recognition patterns that may be in that part of the packet is 
obtained from the data structure. 

The Ethernet packet structure comes in two flavors, the Ethertype packet and 
newer IEEE types, and the packet location that indicates the child is different for both. 
30 The location that for the Ethertype packet indicates the child is a "length" for the IEEE 
type, so a determination is made for the Ethernet packet whether the "next protocol" 
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location contains a value or a length (this is called a "LENGTH" operation). A successful 
LENGTH operation is indicated by contents less than or equal to 05DC 16 , then this is an 
IEEE type Ethernet frame. In such a case, the child recognition pattern is looked for 
elsewhere. Otherwise, the location contains a value that indicates the child. 

5 Note that while this capability of the entry being a value (e.g., for a child protocol 

ID) or a length (indicating further analysis to determine the child protocol) is only used 
for Ethernet packets, in the future, other packets may end up being modified. 
Accordingly, this capability in the form of a macro in the PDL files still enables such 
future packets to be decoded. 

10 Continuing with the example, suppose that the LENGTH operation fails. In that 

case, we have an Ethertype packet, and the next protocol field (containing the child 
recognition pattern) is 2 bytes long starting at offset 12 as shown as packet field 1702 in 
FIG, 17 A. This will be one of the children of the Ethertype shown in table 1712 in 
FIG. 17 A. The PRE uses the information in the data structure to check what the ID code 

15 is for the found 2-byte child recognition pattern. For example, if the child recognition 
pattern is 0800 (Hex), then the protocol is BP. If the child recognition pattern is 0B AD 
(Hex) the protocol is VIP (VINES). 

Note that an alternate embodiment may keep a separate table that includes all the 
child recognition patterns and their corresponding protocol ID's 

20 To follow the example, suppose the child recognition pattern at 1,2,12 is 0800 16 , 

indicating IP. The ID code for the IP protocol is 64 10 ). To continue with the Ethertype 
example, once the parser matches one of the possible children for the protocl— in the 
example, the protocol type is P with an ID of 64-then the parser continues the search for 
the next level. The ED is 64, the length is unknown, and offset is known to be equal or 

25 larger than 14 bytes (12 offset for type, plus 2, the length of type), so the search of the 3- 
D structure commences from location (64, 1) at packet offset 14. A populated node is 
found at (64, 2) at packet offset 14. Heading details are shown as 1750 in FIG. 17B. The 
possible children are shown in table 1752. 

Alternatively, suppose that at (1, 2, 12) there was a length 121 Ijq- This indicates 
30 that this is an IEEE type Ethernet frame, which stores its type elsewhere. The PRE now 
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continues its search at the same level, but for a new ID, that of an IEEE type Ethernet 
frame. An IEEE Ethernet packet has protocol ID 16, so the PRE continues its search of 
the three-dimensional space with ID 16 starting at packet offset 14. 

In our example, suppose there is a "protocol" node code found at (16, 2) at packet 
5 offset 14, and the next protocol is specified by child recognition pattern 0800 16 . This 

indicates that the child is the DP protocol, which has type ID 64. Thus the search 
continues, starting at (64, 1) at packet offset 16. 

Compression. 

As noted above, the 3-D data structure is very large, and sparsely populated. For 
10 example, if 32 bytes are stored at each location, then the length is M by 64 by 512 by 32 
bytes, which is M megabytes. If M = 10,000, then this is about 10 gigabytes. It is not 
practical to include 10 Gbyte of memory in the parser subsystem for storing the database 
308. Thus a compressed form of storing the data is used in the preferred embodiment. The 
compression is preferably carried out by an optimizer component of the compilation 
15 process 310. 

Recall that the data structure is sparse. Different embodiments may use different 
compression schemes that take advantage of the sparseness of the data structure. One 
embodiment uses a modification of multi-dimensional run length encoding. 

Another embodiment uses a smaller number two-dimensional structures to store 
20 the information that otherwise would be in one large three-dimensional structure. The 
second scheme is used in the preferred embodiment. 

FIG. 18 A illustrated how the 3-D array 1800 can be considered a set of 2-D 
arrays, one 2-D array for each protocol (i.e., each value of the protocol ID). The 2-D 
structures are shown as 1802-1, 1802-2, 1802-M for up to M protocol ID's. One table 
25 entry is shown as 1804. Note that the gaps in table are used to illustrate that each 2-D 
structure table is typically large. 

Consider the set of trees that represent the possible protocols. Each node 
represents a protocol, and a protocol may have a child or be a terminal protocol. The base 
(root) of the tree has all packet types as children. The other nodes form the nodes in the 
30 tree at various levels from level 1 to the final terminal nodes of the tree. Thus, one 
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element in the base node may reference node ID 1, another element in the base node may 
reference node ID 2 and so on. As the tree is traversed from the root, there may be points 
in the tree where the same node is referenced next. This would occur, for example, when 
an application protocol like Telnet can run on several transport connections like TCP or 
5 UDP. Rather than repeating the Telnet node, only one node is represented in the patterns 
database 308 which can have several parents. This eliminates considerable space 
explosion. 

Each 2-D structure in FIG. 18A represents a protocol. To enable saving space by 
using only one array per protocol which may have several parents, in one embodiment, 
10 the pattern analysis subprocess keeps a "current header" pointer. Each location (offset) 
index for each protocol 2-D array in the 3-D structure is a relative location starting with 
the start of header for the particular protocol. 

Each of the two-dimensional arrays is sparse. The next step of the optimization, is 
checking all the 2-D arrays against all the other 2-D arrays to find out which ones can 

15 share memory. Many of these 2-D arrays are often sparsely populated in that they each 
have only a small number of valid entries. So, a process of "folding" is next used to 
combine two or more 2-D arrays together into one physical 2-D array without losing the 
identity of any of the original 2-D arrays (i.e., all the 2-D arrays continue to exist 
logically). Folding can occur between any 2-D arrays irrespective of their location in the 

20 tree as long as certain conditions are met. 

Assume two 2-D arrays are being considered for folding. Call the first 2-D arrays 
A and the second 2-D array B. Since both 2-D arrays are partially populated, 2-D array B 
can be combined with 2-D arrays A if and only if none of the individual elements of these 
two 2-D arrays that have the same 2-D location conflict. If the result is foldable, then the 

25 valid entries of 2-D array B are combined with the valid entries of 2-D array A yielding 
one physical 2-D array. However, it is necessary to be able to distinguish the original 2-D 
array A entries from those of 2-D array B. For example, if a parent protocol of the 
protocol represented by 2-D array B wants to reference the protocol ID of 2-D array B, it 
must now reference 2-D array A instead. However, only the entries that were in the 

30 original 2-D array B are valid entries for that lookup. To accomplish this, each element in 
any given 2-D array is tagged with a fold number. When the original tree is created, all 
elements in all the 2-D arrays are initialized with a fold value of zero. Subsequently, if 2- 
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D array B is folded into 2-D array A, all valid elements of 2-D array B are copied to the 
corresponding locations in 2-D array A and are given different fold numbers than any of 
the elements in 2-D array A. For example, if both 2-D array A and 2-D array B were 
original 2-D arrays in the tree (i.e., not previously folded) then, after folding, all the 2-D 
5 array A entries would still have fold 0 and the 2-D array B entries would now all have a 
fold value of 1. After 2-D array B is folded into 2-D array A, the parents of 2-D array B 
need to be notified of the change in the 2-D array physical location of their children and 
the associated change in the expected fold value. 

This folding process can also occur between two 2-D arrays that have already been 
10 folded, as long as none of the individual elements of the two 2-D arrays conflict for the 
same 2-D array location. As before, each of the valid elements in 2-D array B must have 
fold numbers assigned to them that are unique from those of 2-D array A. This is 
accomplished by adding a fixed value to all the 2-D array B fold numbers as they are 
merged into 2-D array A. This fixed value is one larger than the largest fold value in the 
15 original 2-D array A. It is important to note that the fold number for any given 2-D array 
is relative to that 2-D array only and does not span across the entire tree of 2-D arrays. 

This process of folding can now be attempted between all combinations of two 2- 
D arrays until there are no more candidates that qualify for folding. By doing this, the 
total number of 2-D arrays can be significantly reduced. 

20 Whenever a fold occurs, the 3-D structure (i.e., all 2-D arrays) must be searched 

for the parents of the 2-D array being folded into another array. The matching pattern 
which previously was mapped to a protocol ID identifying a single 2-D array must now 
be replaced with the 2-D array ED and the next fold number (i.e., expected fold). 

Thus, in the compressed data structure, each entry valid entry includes the fold 
25 number for that entry, and additionally, the expected fold for the child. 

An alternate embodiment of the data structure used in database 308 is illustrated in 
FIG. 18B. Thus, like the 3-D structure described above, it permits rapid searches to be 
performed by the pattern recognition process 304 by indexing locations in a memory 
rather than performing address link computations. The structure, like that of FIG. 18 A, is 
30 suitable for implementation in hardware, for example, for implementation to work with 
the pattern recognition engine (PRE) 1006 of FIG. 10. 
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A table 1850, called the protocol table (PT) has an entry for each protocol known 
by the monitor 300, and includes some of the characteristics of each protocol, including a 
description of where the field that specifies next protocol (the child recognition pattern) 
can be found in the header, the length of the next protocol field, flags to indicate the 
5 header length and type, and one or more slicer commands, the sheer can build the key 
components and hash components for the packet at this protocol at this layer level. 

For any protocol, there also are one or more lookup tables (LUTs). Thus database 
308 for this embodiment also includes a set of LUTs 1870. Each LUT has 256 entries 
indexed by one byte of the child recognition pattern that is extracted from the next 
10 protocol field in the packet. Such a protocol specification may be several bytes long, and 
so several of LUTs 1870 may need to be looked up for any protocol. 

Each LUTs entry includes a 2-bit "node code" that indicates the nature of the 
contents, including its validity. This node code has one of four values: (1) a "protocol" 
node code indicating to the pattern recognition engine 1006 that a known protocol has 
15 been recognized; (2) an "intermediate" node code, indicating that a multi-byte protocol 
code has been partially recognized, thus permitting chaining a series of LUTs together 
before; (3) a "terminal" node code indicating that there are no children for the protocol 
presently being searched, i.e., the node is a final node in the protocol tree; (4) a "null" 
(also called "flush" and "invalid") node code indicating that there is no valid entry. 

20 In addition to the node code, each LUT entry may include the next LUT number, 

the next protocol number (for looking up the protocol table 1850), the fold of the LUT 
entry, and the next fold to expect. Like in the embodiment implementing a compressed 
form of the 3-D representation, folding is used to reduce the storage requirements for the 
set of LUTs. Since the LUTs 1870 may be sparsely populated, multiple LUTs may be 

25 combined into a single LUT as long as the individual entries do not conflict with each 
other. A fold number is then used to associate each element with its original LUT. 

For a given lookup, the fold number of the lookup must match the fold number in 
the lookup table. The expected fold is obtained from the previous table lookup (the "next 
fold to expect" field). The present implementation uses 5-bits to describe the fold and thus 
30 allows up to 32 tables to be folded into one table. 

When using the data structure of FIG. 1 8B, when a packet arrives at the parser, the 
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virtual base has been pre-pended or is known. The virtual base entry tells the packet 
recognition engine where to find the first child recognition pattern in the packet. The 
pattern recognition engine then extracts the child recognition pattern bytes from the 
packet and uses them as an address into the virtual base table (the first LUT). If the entry 

5 looked up in the specified next LUT by this method matches the expected next fold value 
specified in the virtual base entry, the lookup is deemed valid. The node code is then 
examined. If it is an intermediate node then the next table field obtained from the LUT 
lookup is used as the most significant bits of the address. The next expected fold is also 
extracted from the entry. The pattern recognition engine 1006 then uses the next byte 

10 from the child recognition pattern as the for the next LUT lookup. 

Thus, the operation of the PRE continues until a terminal code is found. The next 
(initially base layer) protocol is looked up in the protocol table 1850 to provide the PRE 
1006 with information on what field in the packet (in input buffer memory 1008 of parser 
subsystem 1000) to use for obtaining the child recognition pattern of the next protocol, 
15 including the size of the field. The child recognition pattern bytes are fetched from the 
input buffer memory 1008. The number of bytes making up the child recognition pattern 
is also now known. 

The first byte of the protocol code bytes is used as the lookup in the next LUT. If a 
LUT lookup results in a node code indicating a protocol node or a terminal node, the Next 
20 LUT and next expected fold is set, and the "next protocol" from LUT lookup is used as an 
index into the protocol table 1850. This provides the instructions to the slicer 1007, and 
where in the packet to obtain the field for the next protocol. Thus, the PRE 1006 
continues until it is done processing all the fields (i.e., the protocols), as indicated by the 
terminal node code reached. 

25 Note that when a child recognition pattern is checked against a table there is 

always an expected fold. If the expected fold matches the fold information in the table, it 
is used to decide what to do next. If the fold does not match, the optimizer is finished. 

Note also that an alternate embodiment may use different size LUTs, and then 
index a LUT by a different amount of the child recognition pattern. 

30 The present implementation of this embodiment allows for child recognition 

patterns of up to four bytes. Child recognition patterns of more than 4 bytes are regarded 
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as special cases. 

In the preferred embodiment, the database is generated by the compiler process 
310. The compiler process first builds a single protocol table of all the links between 
protocols. Links consist of the connection between parent and child protocols. Each 

5 protocol can have zero or more children. If a protocol has children, a link is created that 
consists of the parent protocol, the child protocol, the child recognition pattern, and the 
child recognition pattern size. The compiler first extracts child recognition patterns that 
are greater than two bytes long. Since there are only a few of these, they are handled 
separately. Next sub links are created for each link that has a child recognition pattern size 

10 of two. 

All the links are then formed into the LUTs of 256 entries. 

Optimization is then carried out. The first step in the optimization is checking all 
the tables against all the other tables to find out which ones can share a table. This process 
proceeds the same way as described above for two-dimensional arrays, but now for the 
15 sparse lookup tables. 

Part of the initialization process (e.g., compiler process 310) loads a slicer 
instruction database with data items including of instruction, source address, destination 
address, and length. The PRE 1006 when it sends a slicer instruction sends this instruction 
as an offset into the slicer instruction database. The instruction or Op code tells the slicer 
20 what to extract from the incoming packet and where to put it in the flow signature. 
Writing into certain fields of the flow signature automatically generates a hash. The 
instruction can also tell the slicer how to determine the connection status of certain 
protocols. 

Note that alternate embodiments may generate the pattern, parse and extraction 
25 database other than by compiling PDL files. 

The compilation process 

The compilation process 310 is now described in more detail. This process 310 
includes creating the parsing patterns and extractions database 308 that provides the 
parsing subsystem 301 with the information needed to parse packets and extract 
30 identifying information, and the state processing instructions database 326 that provides 
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the state processes that need to be performed in the state processing operation 328. 

Input to the compiler includes a set of files that describe each of the protocols that 
can occur. These files are in a convenient protocol description language (PDL) which is a 
high level language. PDL is used for specifying new protocols and new levels, including 
5 new applications. The PDL is independent of the different types of packets and protocols 
that may be used in the computer network. A set of PDL files is used to describe what 
information is relevant to packets and packets that need to be decoded. The PDL is further 
used to specify state analysis operations. Thus, the parser subsystem and the analyzer 
subsystems can adapt and be adapted to a variety of different kinds of headers, layers, and 
10 components and need to be extracted or evaluated, for example, in order to build up a 
unique signature. 

There is one file for each packet type and each protocol. Thus there is a PDL file 
for Ethernet packets and there is a PDL file for frame relay packets. The PDL files are 
compiled to form one or more databases that enable monitor 300 to perform different 

15 protocol specific operations on a packet wherein the protocol headers of any protocol are 
located at different locations depending on the parent protocol or protocols used in the 
packet. Thus, the packet monitor adapts to different protocols according to the contents of 
the packet. In particular, the parser subsystem 301 is able to extract different types of data 
for different types of packets. For example, the monitor can know how to interpret a 

20 Ethernet packet, including decoding the header information, and also how to interpret an 
frame relay packet, including decoding the header information. 

The set of PDL files, for example, may include a generic Ethernet packet file. 
There also is included a PDL file for each variation Ethernet file, for example, an IEEE 
Ethernet file. 

25 The PDL file for a protocol provides the information needed by compilation 

process 310 to generate the database 308. That database in turn tells the parser subsystem 
how to parse and/or extract information, including one or more of what protocol-specific 
components of the packet to extract for the flow signature, how to use the components to 
build the flow signature, where in the packet to look for these components, where to look 

30 for any child protocols, and what child recognition patterns to look for. For some 

protocols, the extracted components may include source and destination addresses, and 
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the PDL file may include the order to use these addresses to build the key. For example, 
Ethernet frames have end-point addresses that are useful in building a better flow 
signature. Thus the PDL file for an Ethernet packet includes information on how the 
parsing subsystem is to extract the source and destination addresses, including where the 
5 locations and sizes of those addresses are. In a frame-relay base layer, for example, there 
are no specific end point addresses that help to identify the flow better, so for those type 
of packets, the PDL file does not include information that will cause the parser subsystem 
to extract the end-point addresses. 

Some protocols also include information on connections. TCP is an example of 
10 such a protocol. Such protocol use connection identifiers that exist in every packet. The 
PDL file for such a protocol includes information about what those connection identifiers 
are, where they are, and what their length is. In the example of TCP, for example running 
over IP, these are port numbers. The PDL file also includes information about whether or 
not there are states that apply to connections and disconnections and what the possible 
15 children are states. So, at each of these levels, the packet monitor 300 learns more about 
the packet. The packet monitor 300 can identify that a particular packet is part of a 
particular flow using the connection identifier. Once the flow is identified, the system can 
determine the current state and what states to apply that deal with connections or 
disconnections that exist in the next layer up to these particular packets. 

20 For the particular PDL used in the preferred embodiment, a PDL file may include 

none or more FIELD statement each defining a specific string of bits or bytes (i.e., a field) 
in the packet. A PDL file may further include none or more GROUP statements each used 
to tie together several defined fields. A set of such tied together fields is called a group. A 
PDL file may further include none or more PROTOCOL statements each defining the 

25 order of the fields and groups within the header of the protocol. A PDL file may further 
include none or more FLOW statements each defining a flow by describing where the 
address, protocol type, and port numbers are in a packet. The FLOW statement includes a 
description of how children flows of this protocol are determined using state operations. 
States associated may have state operations that may be used for managing and 

30 maintaining new states learned as more packets of a flow are analyzed. 

FIG. 24 shows a set of PDL files for a layering structure for an Ethernet packet 
that runs TCP on top of IP. Common.pdl (2403) is a file containing the common protocol 
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definitions, i.e., some field definitions for commonly used fields in various network 
protocols. Rows.pdl (2405) is a file containing general flow definitions. Virtual.pdl 
(2407) is a PDL file containing the definition for the VirtualBase layer used. Ethernet.pdl 
(241 1) is the PDL file containing the definition for the Ethernet packet. The decision on 
5 Ethertype vs. IEEE type Ethernet file is described herein. If this is Ethertype, the selection 
is made from the file Ethertype.pdl (2413). In an alternate embodiment, the Ethertype 
selection definition may be in the same Ethernet file 241 1. In a typical implementation, 
PDL files for other Ethernet types would be included. IP.pdl (2415) is a PDL file 
containing the packet definitions for the Internet Protocol. TCP.pdl (2417) is the PDL file 

10 containing the packet definitions for the Transmission Control Protocol, which in this 
case is a transport service for the IP protocol. In addition to extracting the protocol 
information the TCP protocol definition file assists in the process of identification of 
connections for the processing of states. In a typical set of files, there also would be a file 
UDP.pdl for the User Datagram Protocol (UDP) definitions. RPC.pdl (2419) is a PDL file 

15 file containing the packet definitions for Remote Procedure Calls. 

NFS.pdl (2421) is a PDL file containing the packet definitions for the Network 
File System. Other PDL files would typically be included for all the protocols that might 
be encountered by monitor 300. 

Input to the compilation process 3 10 is the set of PDL files (e.g., the files of FIG 
20 24) for all protocols of interest. Input to process 310 may also include layering 

information shown in FIG. 3 as datagram layer selections 338. The layer selections 
information describes the layering of the protocols — what protocol(s) may be on top of 
any particular protocols. For example, IP may run over Ethernet, and also over many 
other types of packets. TCP may run on top of IP. UDP also may run on top of IP. When 
25 no layering information is explicitly included, it is inherent; the PDL files include the 
children protocols, and this provides the layering information. 

The compiling process 310 is illustrated in FIG. 25. The compiler loads the PDL 
source files into a scratch pad memory (step 2503) and reviews the files for the correct 
syntax (parse step 2505). Once completed, the compiler creates an intermediate file 
30 containing all the parse elements (step 2507). The intermediate file in a format called 
"Compiled Protocol Language" (CPL). CPL instructions have a fixed layer format, and 
include all of the patterns, extractions, and states required for each layer and for the entire 
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tree for a layer. The CPL file includes the number of protocols and the protocol 
definitions. A protocol definition for each protocol can include one or more of the 
protocol name, the protocol ID, a header section, a group identification section, sections 
for any particular layers, announcement sections, a payload section, a children section, 
5 and a states section. The CPL file is then run by the optimizer to create the final databases 
that will be used by monitor 300. It would be clear to those in the art that alternate 
implementations of the compilation process 310 may include a different form of 
intermediate output, or no intermediate output at all, directly generating the final 
database(s). 

10 After the parse elements have been created, the compiler builds the flow signature 

elements (step 2509). This creates the extraction operations in CPL that are required at 
each level for each PDL module for the building of the flow signature (and hash key) and 
for links between layers (2009). 

With the flow signature operations complete, the PDL compiler creates (step 
15 25 1 1 ) the operations required to extract the payload elements from each PDL module. 
These payload elements are used by states in other PDL modules at higher layers in the 
processing. 

The last pass is to create the state operations required by each PDL module. The 
state operations are complied from the PDL files and created in CPL form for later use 
20 (2013). 

The CPL file is now run through an optimizer that generates the final databases 
used by monitor 300. 
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Embodiments of the present invention automatically generate flow signatures with 
the necessary recognition patterns and state transition climb procedure. Such comes from 
analyzing packets according to parsing rules, and also generating state transitions to 
5 search for. Applications and protocols, at any level, are recognized through state analysis 
of sequences of packets. 

Note that one in the art will understand that computer networks are used to 
connect many different types of devices, including network appliances such as telephones, 
"Internet" radios, pagers, and so forth. The term computer as used herein encompasses all 
10 such devices and a computer network as used herein includes networks of such 
computers. 

Although the present invention has been described in terms of the presently 
preferred embodiments, it is to be understood that the disclosure is not to be interpreted as 
limiting. Various alterations and modifications will no doubt become apparent to those or 
15 ordinary skill in the art after having read the above disclosure. Accordingly, it is intended 
that the claims be interpreted as covering all alterations and modifications as fall within 
the true spirit and scope of the present invention. 
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CLAIMS 

What is claimed is: 

1 . A packet monitor for examining packets passing through a connection point on a 
computer network in real-time, the packets provided to the packet monitor via a 
packet acquisition device connected to the connection point, the packet monitor 
comprising: 

(a) a packet-buffer memory configured to accept a packet from the packet 
acquisition device; 

(b) a parsing/extraction operations memory configured to store a database of 
parsing/extraction operations that includes information describing how to 
determine at least one of the protocols used in a packet from data in the 
packet; 

(c) a parser subsystem coupled to the packet buffer and to the 
pattern/extraction operations memory, the parser subsystem configured to 
examine the packet accepted by the buffer, extract selected portions of the 
accepted packet, and form a function of the selected portions sufficient to 
identify that the accepted packet is part of a conversational flow-sequence; 

(d) a memory storing a flow-entry database including a plurality of flow- 
entries for conversational flows encountered by the monitor; 

(e) a lookup engine connected to the parser subsystem and to the flow-entry 
database, and configured to determine using at least some of the selected 
portions of the accepted packet if there is an entry in the flow-entry database 
for the conversational flow sequence of the accepted packet; 
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a state patterns/operations memory configured to store a set of predefined 
state transition patterns and state operations such that traversing a particular 
transition pattern as a result of a particular conversational flow-sequence of 
packets indicates that the particular conversational flow-sequence is 
associated with the operation of a particular application program, visiting 
each state in a traversal including carrying out none or more predefined state 
operations; 

a protocol/state identification mechanism coupled to the state 
patterns/operations memory and to the lookup engine, the protocol/state 
identification engine configured to determine the protocol and state of the 
conversational flow of the packet; and 

a state processor coupled to the flow-entiy database, the protocol/state 
identification engine, and to the state patterns/operations memory, the state 
processor, configured to carry out any state operations specified in the state 
patterns/operations memory for the protocol and state of the flow of the 
packet, 

the carrying out of the state operations furthering the process of identifying which 
application program is associated with the conversational flow-sequence of the 
packet, the state processor progressing through a series of states and state operations 
20 until there are no more state operations to perform for the accepted packet, in which 

case the state processor updates the flow-entry, or until a final state is reached that 
indicates that no more analysis of the flow is required, in which case the result of the 
analysis is announced. 

2. A packet monitor according to claim 1, wherein the flow-entry includes the state 
25 of the flow, such that the protocol/state identification mechanism determines the 

state of the packet from the flow-entry in the case that the lookup engine finds a 
flow-entry for the flow of the accepted packet. 

3. A packet monitor according to claim 1, wherein the parser subsystem includes a 
mechanism for building a hash from the selected portions, and wherein the hash is 

30 used by the lookup engine to search the flow-entry database, the hash designed to 

snmaH rtm flow-entries across the flow-entrv database. 
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4. A packet monitor according to claim 1 , further comprising: 

a compiler processor coupled to the parsing/extraction operations memory, the 
compiler processor configured to run a compilation process that includes: 

receiving commands in a high-level protocol description language that 
5 describe the protocols that may be used in packets encountered by the 

monitor, and 

translating the protocol description language commands into a plurality of 
parsing/extraction operations that are initialized into the parsing/extraction 
operations memory. 

10 5. A packet monitor according to claim 4, wherein the protocol description language 
commands also describe a correspondence between a set of one or more application 
programs and the state transition patterns/operations that occur as a result of 
particular conversational flow-sequences associated with an application program, 
wherein the compiler processor is also coupled to the state patterns/operations 

15 memory, and wherein the compilation process further includes translating the 

protocol description language commands into a plurality of state patterns and state 
operations that are initialized into the state patterns/operations memory. 

6. A packet monitor according to claim 1 , further comprising: 

a cache memory coupled to and between the lookup engine and the flow-entry 
20 database providing for fast access of a set of likely-to-be-accessed flow-entries from 

the flow-entry database. 

7. A packet monitor according to claim 6, wherein the cache functions as a fully 
associative, least-recently-used cache memory. 

8. A packet monitor according to claim 7, wherein the cache functions as a fully 
25 associative, least-recently-used cache memory and includes content addressable 

memories configured as a stack. 

9. A packet monitor according to claim 1, wherein one or more statistical measures 
about a flow are stored in each flow-entry, the packet monitor further comprising: 
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a calculator for updating the statistical measures in a flow-entry of the accepted 
packet. 

10. A packet monitor according to claim 9, wherein, when the application program of 
a flow is determined, one or more network usage metrics related to said application 
and determined from the statistical measures are presented to a user for network 
performance monitoring. 

11. A method of examining packets passing through a connection point on a 
computer network, each packets conforming to one or more protocols, the method 
comprising: 

(a) receiving a packet from a packet acquisition device; 

(b) performing one or more parsing/extraction operations on the packet to 
create a parser record comprising a function of selected portions of the 
packet; 

(c) looking up a flow-entry database comprising none or more flow-entries 
for previously encountered conversational flows, the looking up using at 
least some of the selected packet portions and determining if the packet is of 
an existing flow; 

(d) if the packet is of an existing flow, classifying the packet as belonging to 
the found existing flow; and 

(e) if the packet is of a new flow, storing a new flow-entry for the new flow 
in the flow-entry database, including identifying information for future 
packets to be identified with the new flow-entry, 

wherein the parsing/extraction operations depend on one or more of the protocols to 
which the packet conforms. 

12. A method according to claim 1 1, wherein each packet passing through the 
connection point is examined in real time. 

13. A method according to claim 1 1, wherein classifying the packet as belonging to 
the found existing flow includes updating the flow-entry of the existing flow. 



WO 01/01272 



PCT/USOO/18330 



156 

14. A method according to claim 13, wherein updating includes storing one or more 
statistical measures stored in the flow-entry of the existing flow. 

15. A method according to claim 14, wherein the one or more statistical measures 
include measures selected from the set consisting of the total packet count for the 

5 flow, the time, and a differential time from the last entered time to the present time. 

16. A method according to claim 1 1, wherein the function of the selected portions of 
the packet forms a signature that includes the selected packet portions and that can 
identify future packers, wherein the lookup operation uses the signature and wherein 
the identifying information stored in the new or updated flow-entry is a signature for 

l o identifying future packets. 

17. A method according to claim 1 1, wherein at least one of the protocols of the 
packet uses source and destination addresses, and wherein the selected portions of 
the packet include the source and destination addresses. 

18. A method according to claim 17, wherein the function of the selected portions for 
is packets of the same flow is consistent independent of the direction of the packets. 

19. A method according to claim 18, wherein the source and destination addresses 
are placed in an order determined by the order of numerical values of the addresses 
in the function of selected portions. 

20. A method according to claim 19, wherein the numerically lower address is placed 
20 before the numerically higher address in the function of selected portions. 

21. A method according to claim 1 1, wherein the looking up of the flow-entry 
database uses a hash of the selected packet portions. 

22. A method according to claim 1 1, wherein the parsing/extraction operations are 
according to a database of parsing/extraction operations that includes information 

25 describing how to determine a set of one or more protocol dependent extraction 

operations from data in the packet that indicate a protocol used in the packet. 
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23. A method according to claim 1 1 , wherein step (d) includes if the packet is of an 
existing flow, obtaining the last encountered state of the flow and performing any 
state operations specified for the state of the flow starting from the last encountered 
state of the flow; and wherein step (e) includes if the packet is of a new flow, 

5 performing any state operations required for the initial state of the new flow. 

24. A method according to claim 23, wherein the state processing of each received 
packet of a flow furthers the identifying of the application program of the flow. 

25. A method according to claim 23, wherein the state operations include updating 
the flow-entry, including storing identifying information for future packets to be 

io identified with the flow-entry. 

26. A method according to claim 25, wherein the state processing of each received 
packet of a flow furthers the identifying of the application program of the flow. 

27. A method according to claim 23, wherein the state operations include searching 
the parser record for the existence of one or more reference strings. 

15 28. A method according to claim 23, wherein the state operations are carried out by a 
programmable state processor according to a database of protocol dependent state 
operations. 

29. A packet monitor for examining packets passing through a connection point on a 
computer network, each packets conforming to one or more protocols, the monitor 
20 comprising: 

(a) a packet acquisition device coupled to the connection point and 
configured to receive packets passing through the connection point; 

(b) an input buffer memory coupled to and configured to accept a packet 
from the packet acquisition device; 

25 ( C ) a parser subsystem coupled to the input buffer memory and including a 

slicer, the parsing subsystem configured to extract selected portions of the 
accepted packet and to output a parser record containing the selected 
portions; 
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(d) a memory for storing a database comprising none or more flow-entries for 
previously encountered conversational flows, each flow-entry identified by 
identifying information stored in the flow-entry; 

(e) a lookup engine coupled to the output of the parser subsystem and to the 
flow-entry memory and configured to lookup whether the particular packet 
whose parser record is output by the parser subsystem has a matching flow- 
entry, the looking up using at least some of the selected packet portions and 
determining if the packet is of an existing flow; and 

(f) a flow insertion engine coupled to the flow-entry memory and to the 
lookup engine and configured to create a flow-entry in the flow-entry 
database, the flow-entry including identifying information for future packets 
to be identified with the new flow-entry, 

the lookup engine configured such that if the packet is of an existing flow, the 
monitor classifies the packet as belonging to the found existing flow; and if the 
packet is of a new flow, the flow insertion engine stores a new flow-entry for the 
new flow in the flow-entry database, including identifying information for future 
packets to be identified with the new flow-entry, 

wherein the operation of the parser subsystem depends on one or more of the 
protocols to which the packet conforms. 

30. A monitor according to claim 29, wherein each packet passing through the 
connection point is accepted by the packet buffer memory and examined by the 
monitor in real time. 

31. A monitor according to claim 29, wherein the lookup engine updates the flow- 
entry of an existing flow in the case that the lookup is successful. 

32. A monitor according to claim 29, further including a mechanism for building a 
hash from the selected portions, wherein the hash is included in the input for a 
particular packet to the lookup engine, and wherein the hash is used by the lookup 
engine to search the flow-entry database. 
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33. A monitor according to claim 29, further including a memory containing a 
database of parsing/extraction operations, the parsing/extraction database memory 
coupled to the parser subsystem, wherein the parsing/extraction operations are 
according to one or more parsing/extraction operations looked up from the 

5 parsing/extraction database. 

34. A monitor according to claim 33, wherein the database of parsing/extraction 
operations includes information describing how to determine a set of one or more 
protocol dependent extraction operations from data in the packet that indicate a 
protocol used in the packet. 

10 35. A monitor according to claim 29, further including a flow-key-buffer (UFKB) 
coupled to the output of the parser subsystem and to the lookup engine and to the 
flow insertion engine, wherein the output of the parser monitor is coupled to the 
lookup engine via the UFKB, and wherein the flow insertion engine is coupled to 
the lookup engine via the UFKB. 

15 36. A method according to claim 29, further including a state processor coupled to 
the lookup engine and to the flow-entry-database memory, and configured to 
perform any state operations specified for the state of the flow starting from the last 
encountered state of the flow in the case that the packet is from an existing flow, 
and to perform any state operations required for the initial state of the new flow in 

20 the case that the packet is from an existing flow. 

37. A method according to claim 29, wherein the set of possible state operations that 
the state processor is configured to perform includes searching for one or more 
patterns in the packet portions. 

38. A monitor according to claim 36, wherein the state processor is programmable, 

25 the monitor further including a state patterns/operations memory coupled to the state 

processor, the state operations memory configured to store a database of protocol 
dependent state patterns/operations. 
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39. A monitor according to claim 35, further including a state processor coupled to 
the UFKB and to the flow-entry-database memory, and configured to perform any 
state operations specified for the state of the flow starting from the last encountered 
state of the flow in the case that the packet is from an existing flow, and to perform 
any state operations required for the initial state of the new flow in the case that the 
packet is from an existing flow. 

40. A monitor according to claim 36, wherein the state operations include updating 
the flow-entry, including identifying information for future packets to be identified 
with the flow-entry. 

41. A packet monitor according to claim 29, further comprising: 

a compiler processor coupled to the parsing/extraction operations 
memory, the compiler processor configured to run a compilation process that 
includes: 

receiving commands in a high-level protocol description language 
that describe the protocols that may be used in packets encountered 
by the monitor and any children protocols thereof, and 

translating the protocol description language commands into a 
plurality of parsing/extraction operations that are initialized into the 
parsing/extraction operations memory. 

42. A packet monitor according to claim 38, further comprising: 

a compiler processor coupled to the parsing/extraction operations 
memory, the compiler processor configured to run a compilation process that 
includes: 

receiving commands in a high-level protocol description language 
that describe a correspondence between a set of one or more 
application programs and the state transition patterns/operations that 
occur as a result of particular conversational flow-sequences 
associated with an application programs, and 
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translating the protocol description language commands into a 
plurality of state patterns and state operations that are initialized into 
the state patterns/operations memory. 

43. A packet monitor according to claim 29, further comprising: 

5 a cache subsystem coupled to and between the lookup engine and the flow-entry 

database memory providing for fast access of a set of likely-to-be-accessed flow- 
entries from the flow-entry database. 

44. A packet monitor according to claim 43, wherein the cache subsystem is an 
associative cache subsystem including one or more content addressable memory 

10 cells (CAMs). 

45. A packet monitor according to claim 44, wherein the cache subsystem is also a 
least-recently-used cache memory such that a cache miss updates the least recently 
used cache entry. 

46. A packet monitor according to claim 29, wherein each flow-entry stores one or 
15 more statistical measures about the flow, the monitor further comprising 

a calculator for updating at least one of the statistical measures in the flow-entry 
of the accepted packet. 

47. A packet monitor according to claim 46, wherein the one or more statistical 
measures include measures selected from the set consisting of the total packet count 

20 for the flow, the time, and a differential time from the last entered time to the 

present time. 

48. A packet monitor according to claim 46, further including a statistical processor 
configured to determine one or more network usage metrics related to the flow from 
one or more of the statistical measures in a flow-entry. 

25 49. A monitor according to claim 29, wherein: 

flow-entry-database is organized into a plurality of bins that each contain re- 
number of flow-entries, and wherein said bins are accessed via a hash data value 
created by a parser subsystem based on the selected packet portions, wherein N is 
one or more. 
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50. A monitor according to claim 49, wherein the hash data value is used to spread a 
plurality of flow-entries across the flow-entry-database and allows fast lookup of a 
flow-entry and shallower buckets. 

51. A monitor according to claim 36, wherein the state processor analyzes both new 
and existing flows in order to classify them by application and proceeds from state- 
to-state based on a set of predefined rules. 

52. A monitor according to claim 29, wherein the lookup engine begins processing as 
soon as a parser record arrives from the parser subsystem. 

53. A monitor according to claim 36, wherein the lookup engine provides for flow 
state entry checking to see if a flow key should be sent to the state processor, and 
that outputs a protocol identifier for the flow. 

54. A method of examining packets passing through a connection point on a 
computer network, the method comprising: 

(a) receiving a packet from a packet acquisition device; 

(b) performing one or more parsing/extraction operations on the packet 
according to a database of parsing/extraction operations to create a parser 
record comprising a function of selected portions of the packet, the database 
of parsing/extraction operations including information on how to determine 
a set of one or more protocol dependent extraction operations from data in 
the packet that indicate a protocol is used in the packet; 

(c) looking up a flow-entry database comprising none or more flow-entries 
for previously encountered conversational flows, the looking up using at 
least some of the selected packet portions, and determining if the packet is of 
an existing flow; 

(d) if the packet is of an existing flow, obtaining the last encountered state of 
the flow and performing any state operations specified for the state of the 
flow starting from the last encountered state of the flow; and 
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(e) if the packet is of a new flow, performing any analysis required for the 
initial state of the new flow and storing a new flow-entry for the new flow in 
the flow-entry database, including identifying information for future packets 
to be identified with the new flow-entry. 

5 55. A method according to claim 54, wherein one of the state operations specified for 
at least one of the states includes updating the flow-entry, including identifying 
information for future packets to be identified with the flow-entry. 

56. A method according to claim 54, wherein one of the state operations specified for 
at least one of the states includes searching the contents of the packet for at least one 

10 reference string. 

57. A method according to claim 55, wherein one of the state operations specified for 
at least one of the states includes creating a new flow-entry for future packets to be 
identified with the flow, the new flow-entry including identifying information for 
future packets to be identified with the flow-entry. 

15 58. A method according to claim 54, further comprising forming a signature from the 
selected packet portions, wherein the lookup operation uses the signature and 
wherein the identifying information stored in the new or updated flow-entry is a 
signature for identifying future packets. 

59. A method according to claim 54, wherein the state operations are according to a 
20 database of protocol dependent state operations. 

60. A method of performing protocol specific operations on a packet passing through 
a connection point on a computer network, the method comprising: 

(a) receiving the packet; 

(b) receiving a set of protocol descriptions for a plurality of protocols that 
25 conform to a layered model, a protocol description for a particular protocol 

at a particular layer level including: 
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(i) 



the none or more child protocols of the particular protocol, the 
packet including for any particular child protocol of the particular 
protocol information at one or more locations in the packet related to the 
particular child protocol, 



(ii) 



the one or more locations in the packet where information is 
stored related to any child protocol of the particular protocol, and 



(Hi) 



the none or more protocol specific operations to be 



performed on the packet for the particular protocol at the particular layer 
level; and 

(c) performing the protocol specific operations on the packet specified by the 
set of protocol descriptions based on the base protocol of the packet and the 
children of the protocols used in the packet. 

61. A method according to claim 60, wherein step (c) of performing protocol specific 
operations is performed recursively for any children of the children. 

62. A method according to claim 60, wherein which protocol specific operations are 
performed is step (c) depends on the contents of the packet such that the method 
adapts to different protocols according to the contents of the packet. 

63. A method according to claim 60, further comprising: 

storing a database in a memory, the database generated from the set of 
protocol descriptions and including a data structure containing information on 
the possible protocols and organized for locating the child protocol related 
information for any protocol, the data structure contents indexed by a set of 
one or more indices, the database entry indexed by a particular set of index 
values including an indication of validity, 

wherein the child protocol related information includes a child recognition pattern, 

wherein step (c) of performing the protocol specific operations includes, at any 
particular protocol layer level starting from the base level, searching the packet at 
the particular protocol for the child field, the searching including indexing the data 
structure until a valid entry is found, and 
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whereby the data structure is configured for rapid searches using the index set. 

64. A method according to claim 63, wherein the protocol descriptions are provided 
in a protocol description language, the method further comprising: 

compiling the PDL descriptions to produce the database. 

65. A method according to claim 63, wherein the data structure comprises a set of 
arrays, each array identified by a first index, at least one array for each protocol, 
each array further indexed by a second index being the location in the packet where 
the child protocol related information is stored, such that finding a valid entry in the 
data structure provides the location in the packet for finding the child recognition 
pattern for an identified protocol. 

66. A method according to claim 65, wherein each array is further indexed by a third 
index being the size of the region in the packet where the child protocol related 
information is stored, such that finding a valid entry in the data structure provides 
the location and the size of the region in the packet for finding the child recognition 
pattern. 

67. A method according to claim 66, wherein the data structure is compressed 
according to a compression scheme that takes advantage of the sparseness of valid 
entries in the data structure. 

68. A method according to claim 67, wherein the compression scheme combines two 
or more arrays that have no conflicting common entries. 

69. A method according to claim 63, wherein the data structure includes a set of 
tables, each table identified by a first index, at least one table for each protocol, each 
table further indexed by a second index being the child recognition pattern, the data 
structure further including a table that for each protocol provides the location in the 
packet where the child protocol related information is stored, such that finding a 
valid entry in the data structure provides the location in the packet for finding the 
child recognition pattern for an identified protocol. 
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70. A method according to claim 69, wherein the data structure is compressed 
according to a compression scheme that takes advantage of the sparseness of valid 
entries in the set of tables. 

71 . A method according to claim 70, wherein the compression scheme combines two 



72. A method according to claim 60, wherein the protocol specific operations include 
one or more parsing and extraction operations on the packet to extract selected 
portions of the packet to form a function of the selected portions for identifying the 
packet as belonging to a conversational flow. 

10 73. A method according to claim 60, wherein the protocol descriptions are provided 
in a protocol description language. 

74. A method according to claim 73, further comprising: 



5 



or more tables that have no conflicting common entries. 



15 



compiling the PDL descriptions to produce a database and store the 
database in a memory, the database generated from the set of protocol 
descriptions and including a data structure containing information on the 
possible protocols and organized for locating the child protocol related 
information for any protocol, the data structure contents indexed by a set of 
one or more indices, the database entry indexed by a particular set of index 
values including an indication of validity, 



20 



wherein the child protocol related information includes a child recognition pattern, 



and 



25 



wherein the step of performing the protocol specific operations includes, at any 
particular protocol layer level starting from the base level, searching the packet at 
the particular protocol for the child field, the searching including indexing the data 
structure until a valid entry is found, 



whereby the data structure is configured for rapid searches using the index set. 



75 



A method according to claim 72, further comprising: 
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looking up a flow-entry database comprising none or more flow-entries, at least 
one flow-entry for each previously encountered conversational flow, the looking up 
using at least some of the selected packet portions and determining if the packet 
matches an existing flow-entry; 

if the packet is of an existing flow, classifying the packet as belonging to the 
found existing flow; and 

if the packet is of a new flow, storing a new flow-entry for the new flow in the 
flow-entry database, including identifying information for future packets to be 
identified with the new flow-entry, 

wherein the parsing and extraction operations depend on the contents of none or 
more packet headers. 

76. A method according to claim 72, wherein the protocol specific operations further 
include one or more state processing operations that are a function of the state of the 
flow of the packet. 

77. A method according to claim 60, wherein the protocol specific operations include 
one or more state processing operations that are a function of the state of the flow of 
the packet. 

78. A method of analyzing a flow of packets passing through a connection point on a 
computer network, the method comprising: 

(a) receiving a packet from a packet acquisition device; 

(b) looking up a flow-entry database comprising none or more flow-entries 
for previously encountered conversational flows, the looking up to determine 
if the received packet is of an existing flow; 

(d) if the packet is of an existing flow, updating the flow-entry of the existing 
flow including storing one or more statistical measures kept in the flow- 
entry; and 

(e) if the packet is of a new flow, storing a new flow-entry for the new flow 
in the flow-entry database, including storing one or more statistical measures 
kept in the flow-entry, 
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wherein every packet passing though the connection point is received by the packet 
acquisition device. 

79. A method according to claim 78 A further including: 
extracting identifying portions from the packet, 

wherein the looking up uses a function of the identifying portions. 

80. A method according to claim 78, wherein the steps are carried out in real time on 
each packet passing through the connection point. 

81. A method according to claim 78, wherein the one or more statistical measures 
include measures selected from the set consisting of the total packet count for the 
flow, the time, and a differential time from the last entered time to the present time. 

82. A method according to claim 78, further including reporting one or more metrics 
related to the flow of a flow-entry from one or more of the statistical measures in the 
flow-entry. 

83. A method according to claim 84, wherein the metrics include one or more quality 
of service (QOS) metrics. 

84. A method according to claim 82, wherein the reporting is carried out from time to 
time, and wherein the one or more metrics are base metrics related to the time 
interval from the last reporting time. 

85. A method according to claim 84, further comprising calculating one or more 
quality of service (QOS) metrics from the base metrics. 

86. A method according to claim 84, wherein the one or more metrics are selected to 
be scalable such that metrics from contiguous time intervals may be combined to 
determine respective metrics for the combined interval. 

87. A method according to claim 78, wherein step (d) includes if the packet is of an 
existing flow, identifying the last encountered state of the flow and performing any 
state operations specified for the state of the flow starting from the last encountered 
state of the flow; and wherein step (e) includes if the packet is of a new flow, 
performing any state operations required for the initial state of the new flow. 
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88. A method according to claim 87, further including reporting one or more metrics 
related to the flow of a flow-entry from one or more of the statistical measures in the 
flow-entry. 

89. A method according to claim 88, wherein the reporting is carried out from time to 
5 time, and wherein the one or more metrics are base metrics related to the time 

interval from the last reporting time. 

90. A method according to claim 89, wherein the reporting is part of the state 
operations for the state of the flow. 

91. A method according to claim 87, wherein the state operations include updating 
io the flow-entry, including storing identifying information for future packets to be 

identified with the flow-entry. 

92. A method according to claim 91, further including receiving further packets, 
wherein the state processing of each received packet of a flow furthers the 
identifying of the application program of the flow. 

15 93. A method according to claim 92, wherein one or more metrics related to the state 
of the flow are determined as part of the state operations specified for the state of 
the flow. 

94. A packet monitor for examining packets passing through a connection point on a 
computer network, each packets conforming to one or more protocols, the monitor 
20 comprising: 

(a) a packet acquisition device coupled to the connection point and 
configured to receive packets passing through the connection point; 

(b) a memory for storing a database comprising none or more flow-entries for 
previously encountered conversational flows to which a received packet may 

25 belong; and 
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(c) an analyzer subsystem coupled to the packet acquisition device 

configured to lookup whether a received packet belongs to a flow-entry in 
the flow-entry database, to update the flow-entry of the existing flow 
including storing one or more statistical measures kept in the flow-entry in 
the case that the packet is of an existing flow, and to store a new flow-entry 
for the new flow in the flow-entry database, including storing one or more 
statistical measures kept in the flow-entry if the packet is of a new flow. 

95 . A packet monitor according to claim 94, further comprising: 

a parser subsystem coupled to the packet acquisition device and to the 
analyzer subsystem configured to extract identifying information from a 
received packet, 

wherein each flow-entry is identified by identifying information stored in the flow- 
entry, and wherein the cache lookup uses a function of the extracted identifying 
information. 

96. A packet monitor according to claim 96, wherein the one or more statistical 
measures include measures selected from the set consisting of the total packet count 
for the flow, the time, and a differential time from the last entered time to the 
present time. 

97. A packet monitor according to claim 94, further including a statistical processor 
configured to determine one or more metrics related to a flow from one or more of 
the statistical measures in the flow-entry of the flow. 

98. A packet monitor according to claim 97, wherein the statistical processor 
determine and reports the one or more metrics from time to time. 

99. A packet monitor for examining packets passing through a connection point on a 
computer network, each packets conforming to one or more protocols, the monitor 
comprising: 

(a) a packet acquisition device coupled to the connection point and 
configured to receive packets passing through the connection point; 
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(b) a memory for storing a database comprising none or more flow-entries for 
previously encountered conversational flows to which a received packet may 
belong; 

(c) a cache subsystem coupled to the flow-entry database memory providing 
for fast access of flow-entries from the flow-entry database; and 

(d) a lookup engine coupled to the packet acquisition device and to the cache 
subsystem and configured to lookup whether a received packet belongs to a 
flow-entry in the flow-entry database, the looking up being in the cache 
subsystem. 

100. A packet monitor according to claim 99, further comprising: 

a parser subsystem coupled to the packet acquisition device and to the 
lookup engine such that the acquisition device is coupled to the lookup 
engine via the parser subsystem, the parser subsystem configured to extract 
identifying information from a received packet, 

wherein each flow-entry is identified by identifying information stored in the flow- 
entry, and wherein the cache lookup uses a function of the extracted identifying 
information. 

101 . A packet monitor according to claim 100, wherein the cache subsystem is an 
associative cache subsystem including one or more content addressable memory 
cells (CAMs). 

102. A packet monitor according to claim 100, wherein the cache subsystem includes: 

(i) a set of cache memory elements coupled to the flow-entry database 
memory, each cache memory element including an input port to input an 
flow-entry and configured to store a flow-entry of the flow-entry database; 

(ii) a set of content addressable memory cells (CAMs) connected according to 
an order of connections from a top CAM to a bottom CAM, each CAM 
containing an address and a pointer to one of the cache memory elements, 
and including: 



WO 01/01272 



PCT/US00/18330 



172 

a matching circuit having an input such that the CAM asserts a 
match output when the input is the same as the address in the CAM 
cell, an asserted match output indicating a hit, 

a CAM input configured to accept an address and a pointer, and 

a CAM address output and a CAM pointer output; 

(iii) a CAM controller coupled to the CAM set; and 

(iv) a memory controller coupled to the CAM controller, to the cache memory 
set, and to the flow-entry memory, 

wherein the matching circuit inputs of the CAM cells are coupled to the lookup 
engine such that that an input to the matching circuit inputs produces a match output 
in any CAM cell that contains an address equal to the input, and 

wherein the CAM controller is configured such that which cache memory element a 
particular CAM points to changes over time. 

103. A packet monitor according to claim 102, wherein the CAM controller is 
configured such that the bottom CAM points to the least recently used cache 
memory element. 

104. A packet monitor according to claim 103, wherein the address and pointer output 
of each CAM starting from the top CAM is coupled to the address and pointer input 
of the next CAM, the final next CAM being the bottom CAM, and wherein the 
CAM controller is configured such than when there is a cache hit, the address and 
pointer contents of the CAM that produced the hit are put in the top CAM of the 
stack, the address and pointer contents of the CAMs above the CAM that produced 
the asserted match output are shifted down, such that the CAMs are ordered 
according to recentness of use, with the least recently used cache memory element 
pointed to by the bottom CAM and the most recently used cache memory element 
pointed to by the top CAM. 

105. A cache system for looking up one or more elements of an external memory, 
comprising: 
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(a) a set of cache memory elements coupled to the external memory, each 
cache memory element including an input port to input an element of the 
external memory and configured to store the input external memory element; 

(b) a set of content addressable memory cells (CAMs) connected according to 
an order of connections from a top CAM to a bottom CAM, each CAM 
containing an address and a pointer to one of the cache memory elements, 
and including 

(i) a matching circuit having an input such that the CAM asserts a match 
output when the input is the same as the address in the CAM cell, an 
asserted match output indicating a hit, 

(ii) a CAM input configured to accept an address and a pointer, and 

(iii) a CAM address output and a CAM pointer output, and 

(c) a CAM controller coupled to the CAM set; 

(d) a memory controller coupled to the CAM controller, to the cache memory 
set, and to the external memory, 

wherein the matching circuit inputs of the CAM cells are coupled such that that an 
input to the matching circuit inputs produces a match output in any CAM cell that 
contains an address equal to the input, and 

wherein the CAM controller is configured such that which cache memory element a 
particular CAM points to changes over time. 

106. A cache system according to claim 105, wherein the CAM controller is 
configured such that the bottom CAM points to the least recently used cache 
memory element, and wherein the CAM controller is configured to implement a 
least recently used replacement policy such that least recently used cache memory 
element is the first memory element flushed. 
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107. A cache system according to claim 106, wherein the address and pointer output 
of each CAM starting from the top CAM is coupled to the address and pointer input 
of the next CAM, the final next CAM being the bottom CAM, and wherein the 
CAM controller is configured such than when there is a cache hit, the address and 

5 pointer contents of the CAM that produced the hit are put in the top CAM of the 

stack, the address and pointer contents of the CAMs above the CAM that produced 
the asserted match output are shifted down, such that the CAMs are ordered 
according to recentness of use, with the least recently used cache memory element 
pointed to by the bottom CAM and the most recently used cache memory element 

10 pointed to by the top CAM. 

108. A cache system according to claim 107, wherein the CAM controller is 
configured such that replacing any cache memory elements occurs according to the 
inverse order of recentness of use, with the least recently used entry being the first 
flushed cache memory entry. 

15 109. A cache system according to claim 105, wherein each memory element is a page 
of memory. 

1 10. A cache system according to claim 105, wherein each cache memory element is 
provided with an indication of whether or not it is dirty, and wherein the CAM 
controller is configured to clean any dirty cache memory elements by backing up the 

20 dirty contents into the external memory. 

111. A cache system according to claim 1 10, wherein the contents of any cache 
memory element are maintained after cleaning until such cache contents need to be 
replaced according to the LRU replacement policy. 

1 12. A cache system according to claim 106, wherein each cache memory element is 
25 provided with an indication of whether or not it is dirty, and wherein the CAM 

controller is configured to clean any dirty cache memory elements by backing up the 
dirty contents into the external memory. 

113. A cache system according to claim 1 12, wherein the CAM controller is further 
configured to clean any dirty cache memory elements prior to replacing the cache 

30 memory element contents. 
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1 14. A cache system according to claim 1 13, wherein the CAM controller is further 
configured to clean any dirty cache memory elements prior to replacing the cache 
memory element contents. 

115. A cache system according to claim 107, wherein each cache memory element is 
provided with an indication of whether or not it is dirty, and wherein the CAM 
controller is configured to clean dirty cache memory elements by backing up the 
dirty contents into the external memory in reverse order of recentness of use. 

116. A cache system according to claim 115, wherein said cleaning in reverse order of 
recentness of use automatically proceeds whenever the cache controller is idle. 

117. A cache system for looking up one or more elements of an external memory, 
comprising: 

(a) a set of cache memory elements coupled to the external memory, each 
cache memory element including an input port to input an element of the 
external memory and configured to store the input external memory element; 
and 

(b) a set of content addressable memory cells (CAMs) containing an address 
and a pointer to one of the cache memory elements, and including a 
matching circuit having an input such that the CAM asserts a match output 
when the input is the same as the address in the CAM cell, 

wherein which cache memory element a particular CAM points to changes over 
time. 

118. A cache system according to claim 1 17, wherein the CAMs are connected in an 
order from top to bottom, and wherein the bottom CAM points to the least recently 
used cache memory element. 

1 19. A packet monitor for examining all packets passing through a connection point 
on a computer network, the monitor comprising: 

(a) a packet acquisition device coupled to the connection point and 
configured to receive packets passing through the connection point; and 
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(b) a memory for storing a database comprising none or more flow-entries for 
previously encountered conversational flows to which a received packet may 
belong; 

(c) a lookup engine coupled to the packet acquisition device configured to 
lookup whether a received packet belongs to a flow-in the flow-entry 
database, and to determine the state of the flow for the received packet in the 
case that the packet belongs to a flow-entry; 

(d) a state determining mechanism coupled to the lookup engine to determine 
the state of a flow in the case that the received packet does not belong to a 
flow in the flow-entry database; and 

(e) a state processor coupled to the lookup engine and to the state 
determining mechanism configured to perform any state operations specified 
for the state of the flow starting from the last encountered state of the flow in 
the case that the packet is from an existing flow, and to perform any state 
operations required for the initial state of the new flow in the case that the 
packet is from an existing flow. 

120. A monitor according to claim 1 19, wherein the set of possible state operations 
that the state processor is configured to perform includes searching for one or more 
patterns in the packet portions. 

121. A monitor according to claim 120, wherein the monitor processes all packets 
passing through the connection point in real time. 

122. A monitor according to claim 120, wherein the state processor is programmable, 
the monitor further including a state patterns/operations memory coupled to the state 
processor, the state operations memory configured to store a database state 
patterns/operations. 

123. A monitor according to claim 119, further including a buffer coupled to the 
packet acquisition device, to the state processor, and to the lookup engine, the buffer 
configured to accepting at least selected portions of the received packet. 
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124. A monitor according to claim 123, wherein the state processor includes a 

searching apparatus configured to search for a reference string of NR units in the 
buffer contents, the searching apparatus comprising: 

(i) a first reference register configured to receive the NR units of a first 
5 reference string; 

(ii) one or more target data registers coupled in series and coupled to the 
buffer, the target data registers configured to receive contents from the buffer; 
and 

(iii) a first plurality of comparator sets, one comparator set 

10 corresponding to each of a set of starting positions in the target data registers, 

the comparator set of a particular starting position coupled to each unit of the 
first reference register and to NR units of the target data registers starting 
from the particular starting position and comparing the first reference register 
contents to corresponding contents of NR contiguous units of the target data 

1 5 registers starting from the particular starting position, 

such that each comparator set indicates if there is a match of the first reference string 
in the target data starting from its corresponding different starting position, 

whereby the first plurality of comparator sets indicates in parallel if the first reference 
string is contained in the target data registers starting at any of the starting positions. 

20 125. A processor configured to process contents of packets passing through a 
connection point on a computer network, the processor comprising: 



(a) a buffer for receiving at least some of the contents of each packet passing 
through the connection point; 

(b) a memory containing one or more instructions of an instruction set for the 
25 state processor; 

(c) an arithmetic logic unit (ALU) coupled to the buffer; 

(d) a control block coupled to the ALU and to the instruction memory for 
decoding instructions; and 
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(e) a program counter coupled to the instruction memory and to the ALU for 
indicating the next state processor instruction in the memory to process, 

wherein the ALU includes a searching apparatus comprising one or more 
comparators for searching for a reference string in the contents of a packet. 

126. A processor according to claim 125, wherein the state processor processes 
contents of all packets passing through the connection point in real time. 

127. A processor according to claim 125, wherein the instruction set includes an 
instruction for invoking the searching apparatus of the ALU to search for a specified 
reference string in the packet starting at an unknown location within a range of the 
packet. 

128. A processor according to claim 125, wherein the searching apparatus searches for 
any of a set of reference strings in the contents of a packet, and wherein the 
instruction set includes an instruction for invoking the searching apparatus to search 
for any of a set of specified reference strings in the packet starting at an unknown 
location within a range of the packet. 

129. A searching apparatus configured to search for a reference string of NR 
units in target data starting from any of a set of starting positions within the target 
data, the searching apparatus comprising: 

(a) a first reference register configured to receive the NR units of a first 
reference string; 

(b) one or more target data registers coupled in series to receive the target 
data; and 

(c) a first plurality of comparator sets, one comparator set corresponding to 
each of the starting positions, the comparator set of a particular starting 
position coupled to each unit of the first reference register and to NR units of 
the target data registers starting from the particular starting position and 
comparing the first reference register contents to corresponding contents of 
NR contiguous units of the target data registers starting from the particular 
starting position, 
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such that each comparator set indicates if there is a match of the first reference string 
in the target data starting from its corresponding different starting position, 

whereby the first plurality of comparator sets indicates in parallel if the first reference 
string is contained in the target data registers starting at any of the starting positions. 

5 130. A searching apparatus according to claim 129, wherein the set of possible 

starting positions includes Nstart positions, wherein the one or more target data 
registers are coupled in series to receive at least NR+Nstart-1 units of the target data, 
and wherein the first plurality of comparator sets includes Nstart comparator sets, 
one comparator set for each of the Nstart starting positions. 

io 131. A searching apparatus according to claim 130, wherein each of the target 

data registers holds Nstart units of data. 

132. A searching apparatus according to claim 131, wherein Nstart units of the 
target data are clocked into the target data registers in one clock cycle, such that the 
first plurality of comparator sets indicates in one clock cycle if the first reference 

15 string is in the target area starting at any of the Nstart starting positions. 

133. A searching apparatus according to claim 132, further comprising a 
mechanism to specify an offset Noffset, wherein during the first clock cycle of 
operation, the first Noffset starting positions are ignored such that the first plurality 
of comparator sets indicates in the first clock cycle if the first reference string is in 

20 the target area starting at any of the Nstart- Noffset starting positions of the first data 
register that start after the first Noffset starting positions, and wherein during 
subsequent clock cycles all Nstart starting positions are considered, 

whereby in one or more clock cycles, the searching apparatus indicates if the first 
reference string is in the target data starting anywhere other than the first Noffset 
25 units. 

134. A searching apparatus according to claim 129, wherein each comparator 
set includes NR consecutive comparators, each comparator having a reference unit 
input, a target unit input, and an output indicating a match, each comparator coupled 
to the previous comparator's output such that the output of a comparator is asserted 
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when the reference and target data inputs match and the previous comparator's 
output indicates a match. 

135. A searching apparatus according to claim 129, further comprising: 

(d) one or more further reference register for receiving NR units of one or 
more further reference strings; and 

(e) one or more further pluralities of comparator sets, one comparator set for 
each of a corresponding plurality of starting positions, each particular 
comparator set of each further plurality coupled to each unit of the 
corresponding further reference register and to NR units of the data registers 
starting from the particular comparator set's starting position and comparing 
the corresponding further reference register contents to NR units of the target 
data registers starting from the particular comparator set's starting position, 

such that the searching apparatus searches for any one of the first or further reference 
strings of NR units in contents of the target registers starting from any of the starting 
positions. 

136. A searching apparatus according to claim 135, wherein each comparator 
set includes NR consecutive comparators, each comparator having a reference unit 
input, a target data unit input, and an output indicating a match, each comparator 
coupled to the previous comparator's output such that the output of a comparator is 
asserted when the reference and target data inputs match and the previous 
comparator's output indicates a match. 

137. A searching apparatus according to claim 129, wherein each comparator 
set includes NR consecutive comparators, each comparator having a reference unit 
input, a target data unit input, an enable input, and an output indicating a match, such 
that the match output of a comparator is asserted when the reference and target inputs 
match and the enable input is asserted, 

wherein for a particular set of comparators for a particular starting position, the 
reference inputs of consecutive comparators are coupled to consecutive units of the 
reference register, the target data inputs of consecutive comparators are coupled to 
consecutive units of the target data registers starting at the particular starting 
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location, the first comparator of the set is enabled, and the enable input of each 
comparator is coupled to the output of the previous comparator, such that the output 
of the final comparator is asserted when the NR units of the reference string and the 
NR units of the target data agree. 

138. A searching apparatus according to claim 129, wherein the unit is a byte. 

139. A searching apparatus according to claim 137, wherein the final 
comparator outputs of the sets are coupled to a priority selector having an output 
indicating if and where a match of the reference string occurred in the target data. 

140. A searching apparatus according to claim 138, wherein NR is 16 bytes. 

141. A searching apparatus according to claim 130, wherein NR is 16 bytes 
and wherein each of the data registers has Nstart bytes, such that the searching 
apparatus indicates a match starting anywhere within the first data register. 

142. A searching apparatus configured to search for a reference string of NR 
units in a target data stream, the apparatus comprising: 

(a) a first NR-unit comparator having NR pairs of inputs and an output 
indicating a match of each pair of the NR-pairs of inputs; and 

(b) NR connections indicating values of the reference string and defining a 
first axis of a matrix, and NR connections indicating values of the target data 
defining a second axis of the matrix perpendicular to the first axis, the target 
data connections starting from a first starting location of the target data and 
ending at an ending location, 

wherein the first comparator is oriented along the diagonal of the matrix such that 
NR connections of the target data are compared to the NR reference string 
connections. 

143. A searching apparatus according to claim 142, further comprising: 

additional one or more contiguous connections parallel and contiguous to 
the target data connections in the matrix and starting from the ending 
location; and 
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an additional NR-unit comparator for and corresponding to each of the 
additional target data connections, each additional comparators parallel to the 
first comparator and shifted towards the additional target connections in the 
matrix, 

such that each additional comparator compares the reference string to a different set 
of NR units continuous values of the target data starting from a different staring 
point. 

144. A searching apparatus according to claim 143, further comprising: 

one or more further sets of NR-unit comparators; and 

further sets connections corresponding for the further sets of NR-unit 
comparators, the further connections defining one or more additional 
matrices, each further set of connections along the first axis indicating values 
of one or more corresponding further reference strings along the first axis, 
and NR connections indicating values of the target data along the second axis, 

such that each additional comparator set compares the corresponding one of the 
reference strings to a different set of NR contiguous values of the target data starting 
from a different staring point. 
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